You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/29 23:38:32 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4779
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4779/display/redirect>
Changes:
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:31 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:31 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:31 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:33 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:33 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:33 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fbc9a26f8b0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fbc9a26f940> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fbc9a2710d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fea89c4f040> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fea89c4f160> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fea89c4f670> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fea89c4f700> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fea89c4f8b0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fea89c4f940> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fea89c4fa60> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fea89c4faf0> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fea89c4fb80> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fea89c4fc10> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7fea89c4fe50> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fea89c4ff70> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fea89c4fdc0> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fea89c4fee0> ====================
INFO root:portable_runner.py:542 starting control server on port 45311
INFO root:portable_runner.py:542 starting data server on port 44781
INFO root:portable_runner.py:542 starting state server on port 44751
INFO root:portable_runner.py:542 starting logging server on port 46287
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7feabe5903a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'1e6e74d1e8a73101d33a7acd7553123d2b97877af4dbe65ff243172038bde037', worker_id = worker_85
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fea9fd5b3a0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'3beaa6efd983db4dd4568d5b63a12cc926932d04f817dcfc2069a703ed87c81f', worker_id = worker_86
INFO root:portable_runner.py:542 Completed job in 15.47989296913147 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '59599' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:59599
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:58 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:59 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:59 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:37:59 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:38:01 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 29, 2023 11:38:03 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fbc9a26f8b0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fbc9a26f940> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fbc9a2710d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fea89c4f040> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fea89c4f160> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fea89c4f670> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fea89c4f700> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fea89c4f8b0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fea89c4f940> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fea89c4fa60> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fea89c4faf0> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fea89c4fb80> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fea89c4fc10> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7fea89c4fe50> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fea89c4ff70> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fea89c4fdc0> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fea89c4fee0> ====================
INFO root:portable_runner.py:542 starting control server on port 35961
INFO root:portable_runner.py:542 starting data server on port 37915
INFO root:portable_runner.py:542 starting state server on port 42763
INFO root:portable_runner.py:542 starting logging server on port 45907
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7feabe4dc700> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'ffa31993777ef9c0ae37817c00aa7505b92bca0c4d337d2a0bddb256c04a263e', worker_id = worker_87
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7feabe4bee20> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'98dd1c7775afdbe6bb7ad427a9c1166245de4a2a0607749f9976ef306641871b', worker_id = worker_88
INFO root:portable_runner.py:542 Completed job in 15.7884840965271 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7202 deselected in 262.93s (0:04:22) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 902288
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 902807.
Stopping expansion service pid: 902808.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 6s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/k5iknnavavd7i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #4881
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4881/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4880
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4880/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.25.1 to 1.25.8 in /sdks
------------------------------------------
[...truncated 1.50 MB...]
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "UCPxlkhQgvVarIntCoder"
component_coder_ids: "UCPxlkhQgvTimestampedValueCoder"
>
>
coders: <
key: "UCPxlkhQgvKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "UCPxlkhQgvVarIntCoder"
component_coder_ids: "UCPxlkhQgvIterableCoder"
>
>
coders: <
key: "UCPxlkhQgvRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$cd4a8f0d-5f0a-40d4-a435-6e0bfefc1326"
>
>
>
coders: <
key: "UCPxlkhQgvTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000A\032\270\034sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\246-\033F\027\205!8\217\246\240\251QzK\203\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "UCPxlkhQgvVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "UCPxlkhQgvVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "UCPxlkhQgvbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar\022@18badfe2da8bfc1469b801517feb8f4a1d0ffcdc09b98761b389b6d6b58b6af5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/29 17:21:56 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701278516290052048
2023/11/29 17:21:58 Prepared job with id: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2 and staging token: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2
2023/11/29 17:21:59 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2
2023/11/29 17:21:59 Submitted job: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2
2023/11/29 17:21:59 2023-11-29 17:21:59. (5): ==================== <function expand_sdf at 0x7fe04a6a69d0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (6): ==================== <function expand_gbk at 0x7fe04a6a6a60> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (7): ==================== <function sink_flattens at 0x7fe04a6a6b80> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (8): ==================== <function greedily_fuse at 0x7fe04a6a6c10> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (9): ==================== <function read_to_impulse at 0x7fe04a6a6ca0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (10): ==================== <function impulse_to_input at 0x7fe04a6a6d30> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (11): ==================== <function sort_stages at 0x7fe04a6a6f70> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fe04a6a70d0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (13): ==================== <function setup_timer_mapping at 0x7fe04a6a6ee0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (14): ==================== <function populate_data_channel_coders at 0x7fe04a6a7040> ====================
2023/11/29 17:21:59 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: STOPPED
2023/11/29 17:21:59 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: STARTING
2023/11/29 17:21:59 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: RUNNING
2023/11/29 17:21:59 2023-11-29 17:21:59. (15): starting control server on port 40565
2023/11/29 17:21:59 2023-11-29 17:21:59. (16): starting data server on port 45309
2023/11/29 17:21:59 2023-11-29 17:21:59. (17): starting state server on port 42419
2023/11/29 17:21:59 2023-11-29 17:21:59. (18): starting logging server on port 34509
2023/11/29 17:21:59 2023-11-29 17:21:59. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe07f05ed00> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/29 17:22:02 2023-11-29 17:22:02. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/29 17:22:03 2023-11-29 17:22:03. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/29 17:22:04 2023-11-29 17:22:04. (22): Waiting for docker to start up. Current status is running
2023/11/29 17:22:04 2023-11-29 17:22:04. (23): Docker container is running. container_id = b'30b9e64c7e5f6d385241bee0e6759c8144951141000721d127ab589177c79004', worker_id = worker_17
2023/11/29 17:22:05 2023-11-29 17:22:05. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe07e5e04c0> for environment UCPxlkhQgvbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/29 17:22:08 2023-11-29 17:22:08. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/29 17:22:08 2023-11-29 17:22:08. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/29 17:22:09 2023-11-29 17:22:09. (27): Waiting for docker to start up. Current status is running
2023/11/29 17:22:09 2023-11-29 17:22:09. (28): Docker container is running. container_id = b'5a16f4afe6628dbbaacc47619addcc3a0b08e369928d00c209aac6acc7ae4288', worker_id = worker_19
2023/11/29 17:22:16 2023-11-29 17:22:16. (29): Completed job in 17.074530839920044 seconds with state DONE.
2023/11/29 17:22:16 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: DONE
2023/11/29 17:22:16 🐳 Terminating container: 92be383152cc
2023/11/29 17:22:16 🚫 Container terminated: 92be383152cc
--- PASS: TestJDBCIO_PostgresReadWrite (47.84s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 130.850s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44749
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpv8mv8kdy/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40833
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 50s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/3q7wyh2wzrbiw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4879
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4879/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:46 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:48 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6818178b0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa681817940> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6818180d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f059f2cc160> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f059f2cc280> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f059f2cc790> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f059f2cc820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f059f2cc9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f059f2cca60> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f059f2ccb80> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f059f2ccc10> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f059f2ccca0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f059f2ccd30> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f059f2ccf70> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f059f2cd0d0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f059f2ccee0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f059f2cd040> ====================
INFO root:portable_runner.py:543 starting control server on port 37555
INFO root:portable_runner.py:543 starting data server on port 38397
INFO root:portable_runner.py:543 starting state server on port 46155
INFO root:portable_runner.py:543 starting logging server on port 34963
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d28bf760> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2d06adc4d10e202622334e3f756bb5d2ec4793620c11cf9820a8039922bd83fa', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d28d9550> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'175a4b44d7ef528a9666d29d667212840e8063072579d06661f61668eebd9e31', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.745331525802612 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '39567' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:39567
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:14 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:15 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6818178b0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa681817940> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6818180d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f059f2cc160> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f059f2cc280> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f059f2cc790> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f059f2cc820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f059f2cc9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f059f2cca60> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f059f2ccb80> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f059f2ccc10> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f059f2ccca0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f059f2ccd30> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f059f2ccf70> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f059f2cd0d0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f059f2ccee0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f059f2cd040> ====================
INFO root:portable_runner.py:543 starting control server on port 39553
INFO root:portable_runner.py:543 starting data server on port 44155
INFO root:portable_runner.py:543 starting state server on port 46407
INFO root:portable_runner.py:543 starting logging server on port 35547
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d3c5c040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'63cbcbb18835ac4bb6d8b735ab8affd4a93d046d30687e471e606a458fd1045d', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d3c3a430> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'36871f8d00404833ddb26e87435b00cdb9e4688adadac8eebdac650e84bcd9b8', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.595167875289917 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 250.16s (0:04:10) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 355600
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 356172.
Stopping expansion service pid: 356173.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 20s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/7h4vugqh5g5jq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4878
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4878/display/redirect>
Changes:
------------------------------------------
[...truncated 1.37 MB...]
key: "mnSBwjarztIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "mnSBwjarztTimestampedValueCoder"
>
>
coders: <
key: "mnSBwjarztKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mnSBwjarztVarIntCoder"
component_coder_ids: "mnSBwjarztRowCoder"
>
>
coders: <
key: "mnSBwjarztKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mnSBwjarztVarIntCoder"
component_coder_ids: "mnSBwjarztTimestampedValueCoder"
>
>
coders: <
key: "mnSBwjarztKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mnSBwjarztVarIntCoder"
component_coder_ids: "mnSBwjarztIterableCoder"
>
>
coders: <
key: "mnSBwjarztRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$249ea525-6c77-4351-b03e-8c3218acb77d"
>
>
>
coders: <
key: "mnSBwjarztTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006n\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000g\255\345_sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\230\266!\2601\016\334\215\002\352\273A\376*@W\005e\010\014srVo\001\205\366\004s.\001\313\000Dm\3570ors$9z\2164\213\005/\271\347!o\014r\000)oj\220\t\000y.\311\007 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001h\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "mnSBwjarztVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "mnSBwjarztVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "mnSBwjarztbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar\022@18badfe2da8bfc1469b801517feb8f4a1d0ffcdc09b98761b389b6d6b58b6af5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/29 05:22:15 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1701235335458019123
2023/11/29 05:22:18 Prepared job with id: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7 and staging token: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7
2023/11/29 05:22:18 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7
2023/11/29 05:22:18 Submitted job: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7
2023/11/29 05:22:18 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: STOPPED
2023/11/29 05:22:18 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: STARTING
2023/11/29 05:22:18 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: RUNNING
2023/11/29 05:22:18 2023-11-29 05:22:18. (1): ==================== <function annotate_downstream_side_inputs at 0x7fbe93558160> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fbe93558280> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (3): ==================== <function pack_combiners at 0x7fbe93558790> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (4): ==================== <function lift_combiners at 0x7fbe93558820> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (5): ==================== <function expand_sdf at 0x7fbe935589d0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (6): ==================== <function expand_gbk at 0x7fbe93558a60> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (7): ==================== <function sink_flattens at 0x7fbe93558b80> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (8): ==================== <function greedily_fuse at 0x7fbe93558c10> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (9): ==================== <function read_to_impulse at 0x7fbe93558ca0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (10): ==================== <function impulse_to_input at 0x7fbe93558d30> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (11): ==================== <function sort_stages at 0x7fbe93558f70> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fbe935590d0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (13): ==================== <function setup_timer_mapping at 0x7fbe93558ee0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (14): ==================== <function populate_data_channel_coders at 0x7fbe93559040> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (15): starting control server on port 44203
2023/11/29 05:22:18 2023-11-29 05:22:18. (16): starting data server on port 39035
2023/11/29 05:22:18 2023-11-29 05:22:18. (17): starting state server on port 46575
2023/11/29 05:22:18 2023-11-29 05:22:18. (18): starting logging server on port 38031
2023/11/29 05:22:18 2023-11-29 05:22:18. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbe9041fe80> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/29 05:22:18 2023-11-29 05:22:18. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/29 05:22:19 2023-11-29 05:22:19. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/29 05:22:21 2023-11-29 05:22:21. (22): Waiting for docker to start up. Current status is running
2023/11/29 05:22:21 2023-11-29 05:22:21. (23): Docker container is running. container_id = b'6a5033277ed8c5fb8018df9e3b8cfc724f75b96a5098c5c2ef5a570a6a81b742', worker_id = worker_14
2023/11/29 05:22:22 2023-11-29 05:22:22. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbec7eff190> for environment mnSBwjarztbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/29 05:22:23 2023-11-29 05:22:23. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/29 05:22:23 2023-11-29 05:22:23. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/29 05:22:24 2023-11-29 05:22:24. (27): Waiting for docker to start up. Current status is running
2023/11/29 05:22:24 2023-11-29 05:22:24. (28): Docker container is running. container_id = b'6807e03ee3de65a9851aaa3e8ea126a288311b685e12718a08fed85f258ccbb9', worker_id = worker_15
2023/11/29 05:22:33 2023-11-29 05:22:33. (29): Completed job in 14.358946323394775 seconds with state DONE.
2023/11/29 05:22:33 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: DONE
2023/11/29 05:22:33 🐳 Terminating container: 527505d5bd42
2023/11/29 05:22:33 🚫 Container terminated: 527505d5bd42
--- PASS: TestJDBCIO_PostgresReadWrite (41.85s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 119.128s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33335
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmppr64sqfe/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 34955
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 27s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/366omwjh3qy34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4877
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4877/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:27 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:27 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:27 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:29 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:29 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:29 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f515e2c59d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f515e2c5a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f515e2c61f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f293ca01280> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f293ca013a0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f293ca018b0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f293ca01940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f293ca01af0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f293ca01b80> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f293ca01ca0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f293ca01d30> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f293ca01dc0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f293ca01e50> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f293ca020d0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f293ca021f0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f293ca02040> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f293ca02160> ====================
INFO root:portable_runner.py:543 starting control server on port 44585
INFO root:portable_runner.py:543 starting data server on port 43329
INFO root:portable_runner.py:543 starting state server on port 46615
INFO root:portable_runner.py:543 starting logging server on port 45281
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2970b8cfd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'21c2b4b2e551426686ee3a419d439222739ab248f94426d71d093bb4040b66c0', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2971306a30> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'30fd5190d82b7346e71044fa45f226c0dde2ad90f7eb529392e4f8300e6b84ae', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 16.302268743515015 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '51729' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:51729
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:55 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:56 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:56 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:57 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:59 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:39:01 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f515e2c59d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f515e2c5a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f515e2c61f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f293ca01280> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f293ca013a0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f293ca018b0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f293ca01940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f293ca01af0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f293ca01b80> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f293ca01ca0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f293ca01d30> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f293ca01dc0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f293ca01e50> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f293ca020d0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f293ca021f0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f293ca02040> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f293ca02160> ====================
INFO root:portable_runner.py:543 starting control server on port 39373
INFO root:portable_runner.py:543 starting data server on port 39521
INFO root:portable_runner.py:543 starting state server on port 35811
INFO root:portable_runner.py:543 starting logging server on port 46017
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f29713b3550> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'376cf6ea000a952cef2d6a44e412605d1d6623e1ff55ddc4c66640e7cc03c6d3', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f29380bc880> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8dbe4bc00caddc09b0b4125470f878a28e52c1c70d99569a3843f528c4e811db', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.780715465545654 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 280.16s (0:04:40) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1131900
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1132759.
Stopping expansion service pid: 1132760.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 4s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/byrjpb6uqx5lq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4876
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4876/display/redirect>
Changes:
------------------------------------------
[...truncated 1.49 MB...]
component_coder_ids: "TNgLUJTUgBTimestampedValueCoder"
>
>
coders: <
key: "TNgLUJTUgBKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "TNgLUJTUgBVarIntCoder"
component_coder_ids: "TNgLUJTUgBIterableCoder"
>
>
coders: <
key: "TNgLUJTUgBRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$fc2c2ca1-c55c-4109-807d-ccf841365511"
>
>
>
coders: <
key: "TNgLUJTUgBTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006f\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000(UUID;xp\0001z\263a\375\000\021\001\344\000.\001\344\360L.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_idsr\000\tWdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\235\002\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225a(\020.Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\223[~n\006\002gUW~\177\267\324UG\020\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "TNgLUJTUgBVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "TNgLUJTUgBVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "TNgLUJTUgBbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar\022@18badfe2da8bfc1469b801517feb8f4a1d0ffcdc09b98761b389b6d6b58b6af5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/28 17:21:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701192065636538465
2023/11/28 17:21:08 Prepared job with id: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5 and staging token: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5
2023/11/28 17:21:08 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5
2023/11/28 17:21:08 Submitted job: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5
2023/11/28 17:21:08 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: STOPPED
2023/11/28 17:21:08 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: STARTING
2023/11/28 17:21:08 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: RUNNING
2023/11/28 17:21:08 2023-11-28 17:21:08. (1): ==================== <function annotate_downstream_side_inputs at 0x7f19767f4d30> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f19767f4e50> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (3): ==================== <function pack_combiners at 0x7f19767f53a0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (4): ==================== <function lift_combiners at 0x7f19767f5430> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (5): ==================== <function expand_sdf at 0x7f19767f55e0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (6): ==================== <function expand_gbk at 0x7f19767f5670> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (7): ==================== <function sink_flattens at 0x7f19767f5790> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (8): ==================== <function greedily_fuse at 0x7f19767f5820> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (9): ==================== <function read_to_impulse at 0x7f19767f58b0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (10): ==================== <function impulse_to_input at 0x7f19767f5940> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (11): ==================== <function sort_stages at 0x7f19767f5b80> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f19767f5ca0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (13): ==================== <function setup_timer_mapping at 0x7f19767f5af0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (14): ==================== <function populate_data_channel_coders at 0x7f19767f5c10> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (15): starting control server on port 35759
2023/11/28 17:21:08 2023-11-28 17:21:08. (16): starting data server on port 40937
2023/11/28 17:21:08 2023-11-28 17:21:08. (17): starting state server on port 39283
2023/11/28 17:21:08 2023-11-28 17:21:08. (18): starting logging server on port 42703
2023/11/28 17:21:08 2023-11-28 17:21:08. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f19ab144280> for environment TNgLUJTUgBbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/28 17:21:09 2023-11-28 17:21:09. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/28 17:21:09 2023-11-28 17:21:09. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/28 17:21:12 2023-11-28 17:21:12. (22): Waiting for docker to start up. Current status is running
2023/11/28 17:21:12 2023-11-28 17:21:12. (23): Docker container is running. container_id = b'9145aa6862968bdd5830bd310664b26d9cad29ec0cc656f28587f0e93adb724d', worker_id = worker_17
2023/11/28 17:21:13 2023-11-28 17:21:13. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f19ab14d6d0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/28 17:21:15 2023-11-28 17:21:15. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/28 17:21:16 2023-11-28 17:21:16. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/28 17:21:17 2023-11-28 17:21:17. (27): Waiting for docker to start up. Current status is running
2023/11/28 17:21:17 2023-11-28 17:21:17. (28): Docker container is running. container_id = b'a403aa6d7a12bb3da35e4a5a86bf3354afc8b162dc6e6e7dd59d6f4df14e5900', worker_id = worker_19
2023/11/28 17:21:20 2023-11-28 17:21:20. (29): Completed job in 12.165110349655151 seconds with state DONE.
2023/11/28 17:21:20 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: DONE
2023/11/28 17:21:20 🐳 Terminating container: 618fc3f55ecf
2023/11/28 17:21:21 🚫 Container terminated: 618fc3f55ecf
--- PASS: TestJDBCIO_PostgresReadWrite (37.32s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 119.767s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44747
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmphto89l9o/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 45825
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 17s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xapizoejgwiho
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4875
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4875/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f4aa2acf430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f4aa2acf4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f4aa2acfc10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4557fc5ca0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4557fc5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4557fc6310> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4557fc63a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4557fc6550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4557fc65e0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4557fc6700> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4557fc6790> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4557fc6820> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4557fc68b0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4557fc6af0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4557fc6c10> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4557fc6a60> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4557fc6b80> ====================
INFO root:portable_runner.py:543 starting control server on port 42969
INFO root:portable_runner.py:543 starting data server on port 36227
INFO root:portable_runner.py:543 starting state server on port 34659
INFO root:portable_runner.py:543 starting logging server on port 37545
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f457f1b4eb0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bb009b4c4102bf06972acb4029e82a7afa86427aeb2512baadda6625e3cf8279', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458c0a3790> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7eb83ac123fb3219560fe6f8d0cc1e676e15cc68c082aabf1464f8f6793a007f', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.928049087524414 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '50725' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:50725
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:06 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:06 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:08 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:09 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f4aa2acf430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f4aa2acf4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f4aa2acfc10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4557fc5ca0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4557fc5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4557fc6310> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4557fc63a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4557fc6550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4557fc65e0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4557fc6700> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4557fc6790> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4557fc6820> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4557fc68b0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4557fc6af0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4557fc6c10> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4557fc6a60> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4557fc6b80> ====================
INFO root:portable_runner.py:543 starting control server on port 36297
INFO root:portable_runner.py:543 starting data server on port 43125
INFO root:portable_runner.py:543 starting state server on port 39515
INFO root:portable_runner.py:543 starting logging server on port 39039
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458c01b6d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'05a7e84b26c5db7a1bc69e405ca55b932344703029805f4dcaf818ed2873f6e8', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458c03a3d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'70d460748e7a302840128989f3446741e50a957da36cb58dfb4d8003cc7299b0', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.1183180809021 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 249.90s (0:04:09) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3292837
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3293383.
Stopping expansion service pid: 3293384.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 11s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xaeyd5fyddo34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4874
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4874/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:07 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:07 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:07 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:09 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:09 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:09 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fcbe4643550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fcbe46435e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fcbe4643d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc9f75f8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc9f75f8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc9f75f9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc9f75f94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc9f75f9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc9f75f9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc9f75f9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc9f75f98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc9f75f9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc9f75f99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc9f75f9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc9f75f9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc9f75f9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc9f75f9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38345
INFO root:portable_runner.py:543 starting data server on port 43603
INFO root:portable_runner.py:543 starting state server on port 43373
INFO root:portable_runner.py:543 starting logging server on port 36721
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2be6f7f0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bafbd9b6d251071e7d600c3fab817f388df30ebb6a5646f32c99feb071dbe8fa', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2bea0760> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e3bb99b38cecd647ec5089aeeeee07b8ae26845edce9ddc9db45171efb0b3ac7', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.911068439483643 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '34139' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:34139
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:32 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:34 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:36 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:37 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fcbe4643550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fcbe46435e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fcbe4643d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc9f75f8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc9f75f8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc9f75f9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc9f75f94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc9f75f9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc9f75f9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc9f75f9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc9f75f98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc9f75f9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc9f75f99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc9f75f9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc9f75f9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc9f75f9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc9f75f9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 33709
INFO root:portable_runner.py:543 starting data server on port 33087
INFO root:portable_runner.py:543 starting state server on port 42269
INFO root:portable_runner.py:543 starting logging server on port 39357
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2be98ac0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4c0ba66e5bb23330175b691ec808c021fd595725fecfc78aecaa7890346147d8', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2be9aa00> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a18c022adefd172d36e86da79bc23a753238aafa2eeb9ceefd989c886777ed23', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 14.971205711364746 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 246.90s (0:04:06) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2948234
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2948766.
Stopping expansion service pid: 2948767.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 37s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wijgrypuj3zuy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4873
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4873/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:22 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:22 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f56b6dc3550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f56b6dc35e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f56b6dc3d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f580e145dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f580e145ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f580e146430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f580e1464c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f580e146670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f580e146700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f580e146820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f580e1468b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f580e146940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f580e1469d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f580e146c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f580e146d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f580e146b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f580e146ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 43505
INFO root:portable_runner.py:543 starting data server on port 34393
INFO root:portable_runner.py:543 starting state server on port 38249
INFO root:portable_runner.py:543 starting logging server on port 35113
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f58423dae50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'1833cc27871d6736c35c3a613eb086836bba63ae290382bc1bb7a3e355f9bd8d', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5842a40b80> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'57a71893ac82523394b74cc2de2464169c4ad18aa357ee674f6652b1f1e4c4e7', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.805030107498169 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '54227' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:54227
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:49 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:50 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:50 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:50 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:52 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:54 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f56b6dc3550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f56b6dc35e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f56b6dc3d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f580e145dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f580e145ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f580e146430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f580e1464c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f580e146670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f580e146700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f580e146820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f580e1468b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f580e146940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f580e1469d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f580e146c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f580e146d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f580e146b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f580e146ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 39819
INFO root:portable_runner.py:543 starting data server on port 34055
INFO root:portable_runner.py:543 starting state server on port 42287
INFO root:portable_runner.py:543 starting logging server on port 45323
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5842381730> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd9a68c919d23e7e2bec32a0abe07dd1a5bb0408484c9a8feaf167778631da496', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5842a1a670> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'6d34e5f3705561d778a7c359c525e663aedead34c1303d9719769547d0d88d9c', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.58764362335205 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 262.28s (0:04:22) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 49531
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 50362.
Stopping expansion service pid: 50363.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 56s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ehmwe2hjlahus
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4872
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4872/display/redirect?page=changes>
Changes:
[noreply] Respect useReflectApi parameter (#29518)
------------------------------------------
[...truncated 1.50 MB...]
component_coder_ids: "NcmAAlHcwmTimestampedValueCoder"
>
>
coders: <
key: "NcmAAlHcwmKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "NcmAAlHcwmVarIntCoder"
component_coder_ids: "NcmAAlHcwmIterableCoder"
>
>
coders: <
key: "NcmAAlHcwmRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$9b634edd-5a06-4b9c-bc0f-dc486c6715e3"
>
>
>
coders: <
key: "NcmAAlHcwmTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\231\302j\nsr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\260\275V\261s-u\276\356<\316ZP\300C\360\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "NcmAAlHcwmVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "NcmAAlHcwmVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "NcmAAlHcwmbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YJy_D65_0s8MhKzuzafcrJW-TBwDDyfR_sVOEOG27e0.jar\022@609cbf0fae7fd2cf0c84aceecda7dcac95be4c1c030f27d1fec54e10e1b6eded"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YJy_D65_0s8MhKzuzafcrJW-TBwDDyfR_sVOEOG27e0.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/27 17:21:21 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701105681696532349
2023/11/27 17:21:24 Prepared job with id: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f and staging token: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f
2023/11/27 17:21:24 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f
2023/11/27 17:21:24 Submitted job: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f
2023/11/27 17:21:24 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: STOPPED
2023/11/27 17:21:24 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: STARTING
2023/11/27 17:21:24 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: RUNNING
2023/11/27 17:21:24 2023-11-27 17:21:24. (1): ==================== <function annotate_downstream_side_inputs at 0x7f7420f6adc0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f7420f6aee0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (3): ==================== <function pack_combiners at 0x7f7420f6b430> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (4): ==================== <function lift_combiners at 0x7f7420f6b4c0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (5): ==================== <function expand_sdf at 0x7f7420f6b670> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (6): ==================== <function expand_gbk at 0x7f7420f6b700> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (7): ==================== <function sink_flattens at 0x7f7420f6b820> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (8): ==================== <function greedily_fuse at 0x7f7420f6b8b0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (9): ==================== <function read_to_impulse at 0x7f7420f6b940> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (10): ==================== <function impulse_to_input at 0x7f7420f6b9d0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (11): ==================== <function sort_stages at 0x7f7420f6bc10> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f7420f6bd30> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (13): ==================== <function setup_timer_mapping at 0x7f7420f6bb80> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (14): ==================== <function populate_data_channel_coders at 0x7f7420f6bca0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (15): starting control server on port 33601
2023/11/27 17:21:24 2023-11-27 17:21:24. (16): starting data server on port 36739
2023/11/27 17:21:24 2023-11-27 17:21:24. (17): starting state server on port 35171
2023/11/27 17:21:24 2023-11-27 17:21:24. (18): starting logging server on port 34705
2023/11/27 17:21:24 2023-11-27 17:21:24. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f745507e310> for environment NcmAAlHcwmbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/27 17:21:28 2023-11-27 17:21:28. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/27 17:21:28 2023-11-27 17:21:28. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/27 17:21:29 2023-11-27 17:21:29. (22): Waiting for docker to start up. Current status is running
2023/11/27 17:21:29 2023-11-27 17:21:29. (23): Docker container is running. container_id = b'828f1675304bdcdd1fcc946684c2e8ad2b012c46cb768504eeb58f42b9cfaad8', worker_id = worker_17
2023/11/27 17:21:30 2023-11-27 17:21:30. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7455085e80> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/27 17:21:33 2023-11-27 17:21:33. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/27 17:21:34 2023-11-27 17:21:34. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/27 17:21:35 2023-11-27 17:21:35. (27): Waiting for docker to start up. Current status is running
2023/11/27 17:21:35 2023-11-27 17:21:35. (28): Docker container is running. container_id = b'559ecd6b28fd0746e30f8c6e4cf497c94d60c47e2dd679641b0a82ce871a82dc', worker_id = worker_19
2023/11/27 17:21:38 2023-11-27 17:21:38. (29): Completed job in 14.312059879302979 seconds with state DONE.
2023/11/27 17:21:38 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: DONE
2023/11/27 17:21:38 🐳 Terminating container: d40bc6b61e21
2023/11/27 17:21:39 🚫 Container terminated: d40bc6b61e21
--- PASS: TestJDBCIO_PostgresReadWrite (41.15s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 127.133s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42433
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpol7d77g5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 34581
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 30m 30s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xtar7jl6ue5z4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4871
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4871/display/redirect>
Changes:
------------------------------------------
[...truncated 1.51 MB...]
key: "hUoQgeNCUPIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "hUoQgeNCUPTimestampedValueCoder"
>
>
coders: <
key: "hUoQgeNCUPKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "hUoQgeNCUPVarIntCoder"
component_coder_ids: "hUoQgeNCUPRowCoder"
>
>
coders: <
key: "hUoQgeNCUPKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "hUoQgeNCUPVarIntCoder"
component_coder_ids: "hUoQgeNCUPTimestampedValueCoder"
>
>
coders: <
key: "hUoQgeNCUPKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "hUoQgeNCUPVarIntCoder"
component_coder_ids: "hUoQgeNCUPIterableCoder"
>
>
coders: <
key: "hUoQgeNCUPRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$939db966-bc08-431f-97d8-6757c9bd72a0"
>
>
>
coders: <
key: "hUoQgeNCUPTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\216\005\353\353sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\266\224\343J\352\373\366,\306\036E\246\347\375K\355\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "hUoQgeNCUPVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "hUoQgeNCUPVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "hUoQgeNCUPbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/27 11:20:33 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701084033484314365
2023/11/27 11:20:35 Prepared job with id: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0 and staging token: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0
2023/11/27 11:20:36 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0
2023/11/27 11:20:36 Submitted job: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0
2023/11/27 11:20:36 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: STOPPED
2023/11/27 11:20:36 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: STARTING
2023/11/27 11:20:36 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: RUNNING
2023/11/27 11:20:36 2023-11-27 11:20:36. (1): ==================== <function annotate_downstream_side_inputs at 0x7f2744f53dc0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f2744f53ee0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (3): ==================== <function pack_combiners at 0x7f2744f54430> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (4): ==================== <function lift_combiners at 0x7f2744f544c0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (5): ==================== <function expand_sdf at 0x7f2744f54670> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (6): ==================== <function expand_gbk at 0x7f2744f54700> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (7): ==================== <function sink_flattens at 0x7f2744f54820> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (8): ==================== <function greedily_fuse at 0x7f2744f548b0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (9): ==================== <function read_to_impulse at 0x7f2744f54940> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (10): ==================== <function impulse_to_input at 0x7f2744f549d0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (11): ==================== <function sort_stages at 0x7f2744f54c10> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f2744f54d30> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (13): ==================== <function setup_timer_mapping at 0x7f2744f54b80> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (14): ==================== <function populate_data_channel_coders at 0x7f2744f54ca0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (15): starting control server on port 46661
2023/11/27 11:20:36 2023-11-27 11:20:36. (16): starting data server on port 45741
2023/11/27 11:20:36 2023-11-27 11:20:36. (17): starting state server on port 33325
2023/11/27 11:20:36 2023-11-27 11:20:36. (18): starting logging server on port 37317
2023/11/27 11:20:36 2023-11-27 11:20:36. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f27799277c0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/27 11:20:36 2023-11-27 11:20:36. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/27 11:20:36 2023-11-27 11:20:36. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/27 11:20:42 2023-11-27 11:20:42. (22): Waiting for docker to start up. Current status is running
2023/11/27 11:20:42 2023-11-27 11:20:42. (23): Docker container is running. container_id = b'bc55dadb1a98c653cff34f07e2e67cc0dec06cbfee3b205db1f30032e720ffe7', worker_id = worker_16
2023/11/27 11:20:43 2023-11-27 11:20:43. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2779821550> for environment hUoQgeNCUPbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/27 11:20:45 2023-11-27 11:20:45. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/27 11:20:46 2023-11-27 11:20:46. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/27 11:20:47 2023-11-27 11:20:47. (27): Waiting for docker to start up. Current status is running
2023/11/27 11:20:47 2023-11-27 11:20:47. (28): Docker container is running. container_id = b'75e999c9cdf52fc97180f1e24d0dda119f6e463e5236d337d08f99af417957dd', worker_id = worker_18
2023/11/27 11:20:53 2023-11-27 11:20:53. (29): Completed job in 17.105385780334473 seconds with state DONE.
2023/11/27 11:20:53 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: DONE
2023/11/27 11:20:53 🐳 Terminating container: 64967ed720fa
2023/11/27 11:20:53 🚫 Container terminated: 64967ed720fa
--- PASS: TestJDBCIO_PostgresReadWrite (45.94s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 128.289s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40429
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpo9297b7f/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42975
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 9s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/chcahva3dpwzm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4870
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4870/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:39107.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:17 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:17 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:17 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc5488663a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc548866430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc548866b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f13a78d4dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f13a78d4ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f13a78d6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f13a78d64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f13a78d6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f13a78d6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f13a78d6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f13a78d68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f13a78d6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f13a78d69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f13a78d6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f13a78d6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f13a78d6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f13a78d6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 45277
INFO root:portable_runner.py:543 starting data server on port 38153
INFO root:portable_runner.py:543 starting state server on port 45869
INFO root:portable_runner.py:543 starting logging server on port 38837
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13dc217640> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fc9ca506b875b357207c1099b82bad86b6db456053d4c2d5ca9aa9f76b1e7236', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13dc22f4c0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'930b25127ba82732990f65dfc1334a675e89cf545afac38cdc4582243c2ec822', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.158214807510376 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57197' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:57197
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:43 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:44 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:46 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:48 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc5488663a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc548866430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc548866b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f13a78d4dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f13a78d4ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f13a78d6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f13a78d64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f13a78d6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f13a78d6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f13a78d6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f13a78d68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f13a78d6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f13a78d69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f13a78d6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f13a78d6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f13a78d6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f13a78d6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 43831
INFO root:portable_runner.py:543 starting data server on port 45481
INFO root:portable_runner.py:543 starting state server on port 39057
INFO root:portable_runner.py:543 starting logging server on port 42365
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13a4769610> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'47e6a8b134ec51e2654ba46cbfaa95d7075187cc5c03a0c8ccbbb25b7ae63b0b', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13dbdee430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fe2224b543539e40209f992bdf193a764335ff3d724d099bca2914eb2f344439', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.324857711791992 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 267.37s (0:04:27) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3888621
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3889143.
Stopping expansion service pid: 3889144.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 25s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ukdmrggqim3gm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4869
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4869/display/redirect>
Changes:
------------------------------------------
[...truncated 1.57 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:42 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6965ecd3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6965ecd430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6965ecdb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f33a61f3dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f33a61f3ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f33a61f4430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f33a61f44c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f33a61f4670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f33a61f4700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f33a61f4820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f33a61f48b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f33a61f4940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f33a61f49d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f33a61f4c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f33a61f4d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f33a61f4b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f33a61f4ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38887
INFO root:portable_runner.py:543 starting data server on port 44305
INFO root:portable_runner.py:543 starting state server on port 36873
INFO root:portable_runner.py:543 starting logging server on port 37565
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33daa76ca0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'09ac3e8f05d64e24a129248420919462762f855616e15cf2fb4eb4926c729c4c', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33dab22bb0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ff1722c4ba78dd1c2cbe78b82b28f2c9b6b3e26e7e522b94e2022d6898800768', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.123701572418213 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '60029' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:60029
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:09 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:12 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6965ecd3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6965ecd430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6965ecdb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f33a61f3dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f33a61f3ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f33a61f4430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f33a61f44c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f33a61f4670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f33a61f4700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f33a61f4820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f33a61f48b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f33a61f4940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f33a61f49d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f33a61f4c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f33a61f4d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f33a61f4b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f33a61f4ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 33705
INFO root:portable_runner.py:543 starting data server on port 40973
INFO root:portable_runner.py:543 starting state server on port 37507
INFO root:portable_runner.py:543 starting logging server on port 39317
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33dabc8940> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'838f24a8e84f6264afe46551fc842e4a3497b3e1c69a0a151c1076e6d0060f0f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33d9fcc730> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c7883d3998eab7c1992f132ad9242ee9b2077f31cec06c9ac1b45a25e95588c9', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 17.133368253707886 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 258.81s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 933482
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 934608.
Stopping expansion service pid: 934609.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 17s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/z2rybkro6n2jo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4868
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4868/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:37 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:37 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:37 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fdb1bfa13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fdb1bfa1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fdb1bfa1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe972073dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe972073ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe972074430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe9720744c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe972074670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe972074700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe972074820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe9720748b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe972074940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe9720749d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe972074c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe972074d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe972074b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe972074ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 46419
INFO root:portable_runner.py:543 starting data server on port 39435
INFO root:portable_runner.py:543 starting state server on port 40731
INFO root:portable_runner.py:543 starting logging server on port 35169
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5ab5c70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ef5495b93722296a13a33d5e01c11f0289d74b7422a7ec5bb3214b01f8808c5a', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5a85640> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3be114c5aeb71376d9d1b498142e7a812be30c4ac289cc6d41b92a702ddd6209', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 17.249269247055054 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '54491' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:54491
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:05 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:08 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:10 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fdb1bfa13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fdb1bfa1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fdb1bfa1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe972073dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe972073ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe972074430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe9720744c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe972074670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe972074700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe972074820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe9720748b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe972074940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe9720749d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe972074c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe972074d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe972074b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe972074ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 41389
INFO root:portable_runner.py:543 starting data server on port 40757
INFO root:portable_runner.py:543 starting state server on port 40441
INFO root:portable_runner.py:543 starting logging server on port 32843
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5abe640> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3d1c91bf15af93da19211607b3846b0d81d8fe9a3c103c85da2c5f1b185961ac', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5a6c4f0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fe1d132b2efc881516982e802741f39e135721f6251de69aa1065e83e3987273', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 17.05565643310547 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 258.79s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 719601
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 720174.
Stopping expansion service pid: 720175.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 13s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wcmby55czx5am
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4867
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4867/display/redirect>
Changes:
------------------------------------------
[...truncated 1.56 MB...]
component_coder_ids: "GakgXZPzsETimestampedValueCoder"
>
>
coders: <
key: "GakgXZPzsEKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "GakgXZPzsEVarIntCoder"
component_coder_ids: "GakgXZPzsEIterableCoder"
>
>
coders: <
key: "GakgXZPzsERowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$89f5f616-c7ec-472c-aa6c-1fec77801c37"
>
>
>
coders: <
key: "GakgXZPzsETimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000A\032\270\034sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\212\223\336'\362,b\370s\322\227\312\031\241O\177\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "GakgXZPzsEVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "GakgXZPzsEVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "GakgXZPzsEbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/26 11:29:28 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700998168983778685
2023/11/26 11:29:31 Prepared job with id: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8 and staging token: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8
2023/11/26 11:29:31 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8
2023/11/26 11:29:31 Submitted job: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8
2023/11/26 11:29:31 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: STOPPED
2023/11/26 11:29:31 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: STARTING
2023/11/26 11:29:31 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: RUNNING
2023/11/26 11:29:31 2023-11-26 11:29:31. (1): ==================== <function annotate_downstream_side_inputs at 0x7f47db91cdc0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f47db91cee0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (3): ==================== <function pack_combiners at 0x7f47db91d430> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (4): ==================== <function lift_combiners at 0x7f47db91d4c0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (5): ==================== <function expand_sdf at 0x7f47db91d670> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (6): ==================== <function expand_gbk at 0x7f47db91d700> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (7): ==================== <function sink_flattens at 0x7f47db91d820> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (8): ==================== <function greedily_fuse at 0x7f47db91d8b0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (9): ==================== <function read_to_impulse at 0x7f47db91d940> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (10): ==================== <function impulse_to_input at 0x7f47db91d9d0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (11): ==================== <function sort_stages at 0x7f47db91dc10> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f47db91dd30> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (13): ==================== <function setup_timer_mapping at 0x7f47db91db80> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (14): ==================== <function populate_data_channel_coders at 0x7f47db91dca0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (15): starting control server on port 36215
2023/11/26 11:29:31 2023-11-26 11:29:31. (16): starting data server on port 32879
2023/11/26 11:29:31 2023-11-26 11:29:31. (17): starting state server on port 41237
2023/11/26 11:29:31 2023-11-26 11:29:31. (18): starting logging server on port 34395
2023/11/26 11:29:31 2023-11-26 11:29:31. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4808304220> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/26 11:29:35 2023-11-26 11:29:35. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/26 11:29:35 2023-11-26 11:29:35. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/26 11:29:36 2023-11-26 11:29:36. (22): Waiting for docker to start up. Current status is running
2023/11/26 11:29:36 2023-11-26 11:29:36. (23): Docker container is running. container_id = b'd572e8fc854431f806186630cded53c6b29d230ccf19342c28f8dfc1039bb0f3', worker_id = worker_17
2023/11/26 11:29:37 2023-11-26 11:29:37. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f480faaf190> for environment GakgXZPzsEbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/26 11:29:40 2023-11-26 11:29:40. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/26 11:29:40 2023-11-26 11:29:40. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/26 11:29:42 2023-11-26 11:29:42. (27): Waiting for docker to start up. Current status is running
2023/11/26 11:29:42 2023-11-26 11:29:42. (28): Docker container is running. container_id = b'3f12f8b3a6d694ea8e51f03072f95a721a8c90585bc386fb8c810b3520863e3d', worker_id = worker_19
2023/11/26 11:29:49 2023-11-26 11:29:49. (29): Completed job in 17.36914610862732 seconds with state DONE.
2023/11/26 11:29:49 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: DONE
2023/11/26 11:29:49 🐳 Terminating container: af503f7061ed
2023/11/26 11:29:51 🚫 Container terminated: af503f7061ed
--- PASS: TestJDBCIO_PostgresReadWrite (49.13s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 134.776s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33049
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpcpcz0df_/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42191
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 43s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/hp3az4xal64q2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4866
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4866/display/redirect>
Changes:
------------------------------------------
[...truncated 1.74 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:41 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:41 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:42 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:44 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe97daa33a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe97daa3430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe97daa3b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f53cf6a2dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f53cf6a2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f53cf6a3430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f53cf6a34c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f53cf6a3670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f53cf6a3700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f53cf6a3820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f53cf6a38b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f53cf6a3940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f53cf6a39d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f53cf6a3c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f53cf6a3d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f53cf6a3b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f53cf6a3ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 42595
INFO root:portable_runner.py:543 starting data server on port 42143
INFO root:portable_runner.py:543 starting state server on port 42827
INFO root:portable_runner.py:543 starting logging server on port 34625
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402aa8730> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'842e87397b2fe252afcfdabd9341fb694e9e7c768174b601b3eaf20b72f211a9', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402aa1790> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'dbecb72fa9e41eea4d9f31297dc4edd193628f184d91f3e3381a7c96cd78e76e', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.315377235412598 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '41977' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:41977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:08 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:09 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:11 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:13 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe97daa33a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe97daa3430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe97daa3b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f53cf6a2dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f53cf6a2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f53cf6a3430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f53cf6a34c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f53cf6a3670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f53cf6a3700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f53cf6a3820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f53cf6a38b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f53cf6a3940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f53cf6a39d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f53cf6a3c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f53cf6a3d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f53cf6a3b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f53cf6a3ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 41239
INFO root:portable_runner.py:543 starting data server on port 40605
INFO root:portable_runner.py:543 starting state server on port 38029
INFO root:portable_runner.py:543 starting logging server on port 42021
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402a21fa0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'84b56de02b3d7d5cc9c29b197c730a3f08ae379bb5fc3466dc2d86c8af984576', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402a31640> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'31019d67cc78cb46cfeff037845652554005e92743622388f531dd42e41fa460', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 18.08107018470764 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 263.35s (0:04:23) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4039999
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4041289.
Stopping expansion service pid: 4041290.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 18s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cwx2q66cffogw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4865
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4865/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
key: "mbgxUdnLleIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "mbgxUdnLleTimestampedValueCoder"
>
>
coders: <
key: "mbgxUdnLleKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mbgxUdnLleVarIntCoder"
component_coder_ids: "mbgxUdnLleRowCoder"
>
>
coders: <
key: "mbgxUdnLleKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mbgxUdnLleVarIntCoder"
component_coder_ids: "mbgxUdnLleTimestampedValueCoder"
>
>
coders: <
key: "mbgxUdnLleKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mbgxUdnLleVarIntCoder"
component_coder_ids: "mbgxUdnLleIterableCoder"
>
>
coders: <
key: "mbgxUdnLleRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$f832e729-743c-47d5-9223-8edd2d3f63f2"
>
>
>
coders: <
key: "mbgxUdnLleTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\260\220K\340sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\270\317\003\200\334$S\016 \2627I\323QK&\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "mbgxUdnLleVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "mbgxUdnLleVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "mbgxUdnLlebeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/25 23:20:14 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700954414113621893
2023/11/25 23:20:16 Prepared job with id: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab and staging token: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab
2023/11/25 23:20:16 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab
2023/11/25 23:20:16 Submitted job: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab
2023/11/25 23:20:16 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: STOPPED
2023/11/25 23:20:16 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: STARTING
2023/11/25 23:20:16 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: RUNNING
2023/11/25 23:20:16 2023-11-25 23:20:16. (1): ==================== <function annotate_downstream_side_inputs at 0x7f269ccd9dc0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f269ccd9ee0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (3): ==================== <function pack_combiners at 0x7f269ccda430> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (4): ==================== <function lift_combiners at 0x7f269ccda4c0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (5): ==================== <function expand_sdf at 0x7f269ccda670> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (6): ==================== <function expand_gbk at 0x7f269ccda700> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (7): ==================== <function sink_flattens at 0x7f269ccda820> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (8): ==================== <function greedily_fuse at 0x7f269ccda8b0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (9): ==================== <function read_to_impulse at 0x7f269ccda940> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (10): ==================== <function impulse_to_input at 0x7f269ccda9d0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (11): ==================== <function sort_stages at 0x7f269ccdac10> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f269ccdad30> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (13): ==================== <function setup_timer_mapping at 0x7f269ccdab80> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (14): ==================== <function populate_data_channel_coders at 0x7f269ccdaca0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (15): starting control server on port 44603
2023/11/25 23:20:16 2023-11-25 23:20:16. (16): starting data server on port 37907
2023/11/25 23:20:16 2023-11-25 23:20:16. (17): starting state server on port 33065
2023/11/25 23:20:16 2023-11-25 23:20:16. (18): starting logging server on port 46513
2023/11/25 23:20:16 2023-11-25 23:20:16. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26d06928b0> for environment mbgxUdnLlebeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/25 23:20:20 2023-11-25 23:20:20. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/25 23:20:21 2023-11-25 23:20:21. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/25 23:20:22 2023-11-25 23:20:22. (22): Waiting for docker to start up. Current status is running
2023/11/25 23:20:22 2023-11-25 23:20:22. (23): Docker container is running. container_id = b'25e05a7549c25a1b93d5ae5609d7a3871095b6e9aa43a8eda6ab2238753378db', worker_id = worker_17
2023/11/25 23:20:23 2023-11-25 23:20:23. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26d06381f0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/25 23:20:25 2023-11-25 23:20:25. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/25 23:20:26 2023-11-25 23:20:26. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/25 23:20:27 2023-11-25 23:20:27. (27): Waiting for docker to start up. Current status is running
2023/11/25 23:20:27 2023-11-25 23:20:27. (28): Docker container is running. container_id = b'0bbfd0509db7e63f90f45f2c4f0fbc2b06bca37bff72717acc72c6c64ffd9978', worker_id = worker_19
2023/11/25 23:20:30 2023-11-25 23:20:30. (29): Completed job in 13.989140272140503 seconds with state DONE.
2023/11/25 23:20:30 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: DONE
2023/11/25 23:20:30 🐳 Terminating container: 518eee93d188
2023/11/25 23:20:31 🚫 Container terminated: 518eee93d188
--- PASS: TestJDBCIO_PostgresReadWrite (45.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 104.704s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39301
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp82ydz3mc/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38469
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 57s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cfefgmh7ehety
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4864
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4864/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "XymmTxWVVDVarIntCoder"
component_coder_ids: "XymmTxWVVDTimestampedValueCoder"
>
>
coders: <
key: "XymmTxWVVDKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "XymmTxWVVDVarIntCoder"
component_coder_ids: "XymmTxWVVDIterableCoder"
>
>
coders: <
key: "XymmTxWVVDRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$75b24255-90a3-4e57-a3b8-6e91fc0304c4"
>
>
>
coders: <
key: "XymmTxWVVDTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000fo\3576sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\244%?%!\023\233\247\327\212\324\373\275#G\233\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "XymmTxWVVDVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "XymmTxWVVDVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "XymmTxWVVDbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/25 17:20:51 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700932851950145836
2023/11/25 17:20:54 Prepared job with id: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474 and staging token: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474
2023/11/25 17:20:54 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474
2023/11/25 17:20:54 Submitted job: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474
2023/11/25 17:20:54 2023-11-25 17:20:54. (5): ==================== <function expand_sdf at 0x7fe584d94670> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (6): ==================== <function expand_gbk at 0x7fe584d94700> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (7): ==================== <function sink_flattens at 0x7fe584d94820> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (8): ==================== <function greedily_fuse at 0x7fe584d948b0> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (9): ==================== <function read_to_impulse at 0x7fe584d94940> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (10): ==================== <function impulse_to_input at 0x7fe584d949d0> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (11): ==================== <function sort_stages at 0x7fe584d94c10> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fe584d94d30> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (13): ==================== <function setup_timer_mapping at 0x7fe584d94b80> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (14): ==================== <function populate_data_channel_coders at 0x7fe584d94ca0> ====================
2023/11/25 17:20:54 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: STOPPED
2023/11/25 17:20:54 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: STARTING
2023/11/25 17:20:54 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: RUNNING
2023/11/25 17:20:54 2023-11-25 17:20:54. (15): starting control server on port 39771
2023/11/25 17:20:54 2023-11-25 17:20:54. (16): starting data server on port 46767
2023/11/25 17:20:54 2023-11-25 17:20:54. (17): starting state server on port 35063
2023/11/25 17:20:54 2023-11-25 17:20:54. (18): starting logging server on port 42877
2023/11/25 17:20:54 2023-11-25 17:20:54. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe5b96c0820> for environment XymmTxWVVDbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/25 17:20:58 2023-11-25 17:20:58. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/25 17:20:59 2023-11-25 17:20:59. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/25 17:21:00 2023-11-25 17:21:00. (22): Waiting for docker to start up. Current status is running
2023/11/25 17:21:00 2023-11-25 17:21:00. (23): Docker container is running. container_id = b'403def393187fed0d0745f9289487eeb542a61eeb46742b86c9913b101c2592a', worker_id = worker_17
2023/11/25 17:21:01 2023-11-25 17:21:01. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe5b9665400> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/25 17:21:03 2023-11-25 17:21:03. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/25 17:21:04 2023-11-25 17:21:04. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/25 17:21:05 2023-11-25 17:21:05. (27): Waiting for docker to start up. Current status is running
2023/11/25 17:21:05 2023-11-25 17:21:05. (28): Docker container is running. container_id = b'd28d0c1c13a59d530cbedda4c211acebc91b052fba4e3bc55b720d01de3a3a2b', worker_id = worker_19
2023/11/25 17:21:08 2023-11-25 17:21:08. (29): Completed job in 14.056246995925903 seconds with state DONE.
2023/11/25 17:21:08 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: DONE
2023/11/25 17:21:08 🐳 Terminating container: 6fdf8c80df5a
2023/11/25 17:21:09 🚫 Container terminated: 6fdf8c80df5a
--- PASS: TestJDBCIO_PostgresReadWrite (43.01s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 122.307s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39087
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmps075rlmw/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 46751
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 18s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/shtlsvynx5mmc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4863
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4863/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feebb16f3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feebb16f430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feebb16fb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fcbed0f5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fcbed0f5ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fcbed0f6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fcbed0f64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fcbed0f6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fcbed0f6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fcbed0f6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fcbed0f68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fcbed0f6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fcbed0f69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fcbed0f6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fcbed0f6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fcbed0f6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fcbed0f6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 35771
INFO root:portable_runner.py:543 starting data server on port 35275
INFO root:portable_runner.py:543 starting state server on port 42765
INFO root:portable_runner.py:543 starting logging server on port 34173
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc20768520> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2823f09bbcfda332a5e79762be586f1bcccccc72378c4e38497ed7b558a07b70', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc206cd940> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'96b2d9f8e95bad1441570b1990f7df93fa07054fd22eb4f5be39a6e1acd60dd9', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.229727506637573 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '53585' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:53585
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:48 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:49 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:52 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:53 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feebb16f3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feebb16f430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feebb16fb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fcbed0f5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fcbed0f5ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fcbed0f6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fcbed0f64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fcbed0f6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fcbed0f6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fcbed0f6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fcbed0f68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fcbed0f6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fcbed0f69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fcbed0f6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fcbed0f6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fcbed0f6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fcbed0f6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38585
INFO root:portable_runner.py:543 starting data server on port 38931
INFO root:portable_runner.py:543 starting state server on port 41229
INFO root:portable_runner.py:543 starting logging server on port 44441
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc2064cc10> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b3fc96791e6a1a6e8baa886a6746082a10f5e20da05f1a89c9b2dc3ad629149f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc2065d970> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e130e13fbb3b25a67c42f6c1c830a26ec743830e7236ef190e71e156f8538938', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.614453315734863 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 262.65s (0:04:22) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2874226
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2874744.
Stopping expansion service pid: 2874745.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 57s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/folpzjjp6njau
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4862
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4862/display/redirect>
Changes:
------------------------------------------
[...truncated 932.17 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb6ef3ee3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb6ef3ee430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb6ef3eeb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fac4d460dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fac4d460ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fac4d461430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fac4d4614c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fac4d461670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fac4d461700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fac4d461820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fac4d4618b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fac4d461940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fac4d4619d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fac4d461c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fac4d461d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fac4d461b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fac4d461ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 39247
INFO root:portable_runner.py:543 starting data server on port 42883
INFO root:portable_runner.py:543 starting state server on port 42403
INFO root:portable_runner.py:543 starting logging server on port 45383
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c0df430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'042ed3e3d6fb015aca1be7752c95cb87b75982e8caa52698a1f22905799977da', worker_id = worker_60
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c1820d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'768504589d27c5f344e089708afaee0af9bff3c7fbdb06cf68acd61f0a4428ba', worker_id = worker_61
INFO root:portable_runner.py:543 Completed job in 15.282720565795898 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '53029' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:53029
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:39 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:40 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:41 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:44 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:46 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb6ef3ee3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb6ef3ee430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb6ef3eeb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fac4d460dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fac4d460ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fac4d461430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fac4d4614c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fac4d461670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fac4d461700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fac4d461820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fac4d4618b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fac4d461940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fac4d4619d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fac4d461c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fac4d461d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fac4d461b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fac4d461ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38605
INFO root:portable_runner.py:543 starting data server on port 38999
INFO root:portable_runner.py:543 starting state server on port 44661
INFO root:portable_runner.py:543 starting logging server on port 34047
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c166400> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e9b78be6299a296daf62d3c6ec41164c74a64c278952809ccbaab9a6c59cd4a2', worker_id = worker_62
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c661a90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'25b56ecc3e6124710f272b169b21f5ca11d9a27d12a0eb97ecdd80a89f7d8fbb', worker_id = worker_63
INFO root:portable_runner.py:543 Completed job in 15.42707085609436 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 263.45s (0:04:23) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2433598
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2434493.
Stopping expansion service pid: 2434494.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':release:go-licenses:go:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 23m 49s
257 actionable tasks: 169 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cactprsxzwoa2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4861
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4861/display/redirect?page=changes>
Changes:
[noreply] Revert "revert protobuf version (#29523)" (#29530)
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:30 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:30 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:30 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f72808a53a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f72808a5430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f72808a5b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff8152b8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff8152b8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff8152b9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff8152b94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff8152b9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff8152b9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff8152b9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff8152b98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff8152b9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff8152b99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff8152b9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff8152b9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff8152b9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff8152b9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 41115
INFO root:portable_runner.py:543 starting data server on port 39055
INFO root:portable_runner.py:543 starting state server on port 38653
INFO root:portable_runner.py:543 starting logging server on port 39157
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff848975040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c43408e5d78d16f1a586ce741397561cfbf603b5dce75155b4a3a38490ee005b', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff841c4cb80> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'39ec63ee34ff01573b03a99acafa8e9410132ad115432a027f7a50ededf4f2b6', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.095734119415283 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '59609' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:59609
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:56 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:57 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:57 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:57 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:59 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:37:01 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f72808a53a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f72808a5430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f72808a5b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff8152b8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff8152b8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff8152b9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff8152b94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff8152b9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff8152b9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff8152b9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff8152b98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff8152b9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff8152b99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff8152b9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff8152b9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff8152b9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff8152b9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 36259
INFO root:portable_runner.py:543 starting data server on port 44973
INFO root:portable_runner.py:543 starting state server on port 41987
INFO root:portable_runner.py:543 starting logging server on port 45619
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff84893bd00> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd03e8a5cf8a07c4d01ece96c94bdd18c0b2a60fc91bdf763dbaa313130619433', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff841c772e0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f8986eb85d711795e1c0e96ae474010d50990a8cc15b0b01f6e68fa0240daec0', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.139945983886719 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 260.96s (0:04:20) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2159896
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2160385.
Stopping expansion service pid: 2160386.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 2s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wthjxeqdgcfvs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4860
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4860/display/redirect>
Changes:
------------------------------------------
[...truncated 1.51 MB...]
component_coder_ids: "NAgNzteutQTimestampedValueCoder"
>
>
coders: <
key: "NAgNzteutQKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "NAgNzteutQVarIntCoder"
component_coder_ids: "NAgNzteutQIterableCoder"
>
>
coders: <
key: "NAgNzteutQRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$a7c5de7e-7ebf-4f6d-91c3-52965679ffbe"
>
>
>
coders: <
key: "NAgNzteutQTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000Q\253`#sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\263\232\305\024u\007\337\003\n\233\014-\273<A\373\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "NAgNzteutQVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "NAgNzteutQVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "NAgNzteutQbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar\022@a2b20831e98dc7a75c21457117f7405a629cf6e0cbc116bf0954972d2976fcc5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/24 17:20:31 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700846431825437031
2023/11/24 17:20:34 Prepared job with id: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30 and staging token: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30
2023/11/24 17:20:34 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30
2023/11/24 17:20:34 Submitted job: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30
2023/11/24 17:20:34 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: STOPPED
2023/11/24 17:20:34 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: STARTING
2023/11/24 17:20:34 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: RUNNING
2023/11/24 17:20:34 2023-11-24 17:20:34. (1): ==================== <function annotate_downstream_side_inputs at 0x7fda21b18ee0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fda21b19040> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (3): ==================== <function pack_combiners at 0x7fda21b19550> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (4): ==================== <function lift_combiners at 0x7fda21b195e0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (5): ==================== <function expand_sdf at 0x7fda21b19790> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (6): ==================== <function expand_gbk at 0x7fda21b19820> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (7): ==================== <function sink_flattens at 0x7fda21b19940> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (8): ==================== <function greedily_fuse at 0x7fda21b199d0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (9): ==================== <function read_to_impulse at 0x7fda21b19a60> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (10): ==================== <function impulse_to_input at 0x7fda21b19af0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (11): ==================== <function sort_stages at 0x7fda21b19d30> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fda21b19e50> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (13): ==================== <function setup_timer_mapping at 0x7fda21b19ca0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (14): ==================== <function populate_data_channel_coders at 0x7fda21b19dc0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (15): starting control server on port 33919
2023/11/24 17:20:34 2023-11-24 17:20:34. (16): starting data server on port 46157
2023/11/24 17:20:34 2023-11-24 17:20:34. (17): starting state server on port 35483
2023/11/24 17:20:34 2023-11-24 17:20:34. (18): starting logging server on port 40347
2023/11/24 17:20:34 2023-11-24 17:20:34. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fda564457c0> for environment NAgNzteutQbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/24 17:20:38 2023-11-24 17:20:38. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/24 17:20:39 2023-11-24 17:20:39. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/24 17:20:40 2023-11-24 17:20:40. (22): Waiting for docker to start up. Current status is running
2023/11/24 17:20:40 2023-11-24 17:20:40. (23): Docker container is running. container_id = b'42fa4221390591f8a81ee2d363ffb39a0353cecbdf35579a1f7eed9c9f153317', worker_id = worker_17
2023/11/24 17:20:41 2023-11-24 17:20:41. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fda559d78b0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/24 17:20:43 2023-11-24 17:20:43. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/24 17:20:44 2023-11-24 17:20:44. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/24 17:20:45 2023-11-24 17:20:45. (27): Waiting for docker to start up. Current status is running
2023/11/24 17:20:45 2023-11-24 17:20:45. (28): Docker container is running. container_id = b'a579924f5944e8877ff03e7ddb35612db95217321c3b865637083ec839192c7f', worker_id = worker_19
2023/11/24 17:20:48 2023-11-24 17:20:48. (29): Completed job in 14.266002178192139 seconds with state DONE.
2023/11/24 17:20:48 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: DONE
2023/11/24 17:20:48 🐳 Terminating container: d14cb48fd7a5
2023/11/24 17:20:49 🚫 Container terminated: d14cb48fd7a5
--- PASS: TestJDBCIO_PostgresReadWrite (39.92s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 121.569s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43075
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpw4i9jsv1/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43573
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 57s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/4xefytnhemgl6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4859
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4859/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:17 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:17 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:18 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fafac7f74c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fafac7f7550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fafac7f7ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f272cf92ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f272cf93040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f272cf93550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f272cf935e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f272cf93790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f272cf93820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f272cf93940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f272cf939d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f272cf93a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f272cf93af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f272cf93d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f272cf93e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f272cf93ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f272cf93dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 35481
INFO root:portable_runner.py:543 starting data server on port 37313
INFO root:portable_runner.py:543 starting state server on port 36143
INFO root:portable_runner.py:543 starting logging server on port 33327
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f27618f9910> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3b8802857882a9dcf1a7ae0ac2c4a9f62d8a957f22b493817aa4fc944c7001ce', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2760dcb250> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cdaa4548d93d27483bac6faa78e7c5a02fb4cdc5e8084305082c81f96d873c6b', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.137111186981201 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '48165' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:48165
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:44 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:46 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:48 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:49 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fafac7f74c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fafac7f7550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fafac7f7ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f272cf92ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f272cf93040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f272cf93550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f272cf935e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f272cf93790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f272cf93820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f272cf93940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f272cf939d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f272cf93a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f272cf93af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f272cf93d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f272cf93e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f272cf93ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f272cf93dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 41097
INFO root:portable_runner.py:543 starting data server on port 37033
INFO root:portable_runner.py:543 starting state server on port 34355
INFO root:portable_runner.py:543 starting logging server on port 40131
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2760deeee0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b2fc2fcaee92edf62052d8dccc6072ac1215892fe9df574134cd9dccae95dc10', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2760dab3d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fc574219cc4bb961358a5505e17117b90676c134218f4ca44eb99e5c47b3a625', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.566296100616455 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 258.05s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1181724
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1182221.
Stopping expansion service pid: 1182222.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 53s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/jtq6e5p4zzfdo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4858
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4858/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f656b3ef4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f656b3ef550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f656b3efca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd5d1304ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd5d1305040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd5d1305550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd5d13055e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd5d1305790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd5d1305820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd5d1305940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd5d13059d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd5d1305a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd5d1305af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd5d1305d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd5d1305e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd5d1305ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd5d1305dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 37091
INFO root:portable_runner.py:543 starting data server on port 45075
INFO root:portable_runner.py:543 starting state server on port 45355
INFO root:portable_runner.py:543 starting logging server on port 38675
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604d519d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2e0c55d3c7b1ca4f428bf4cd56a20b3abb9e818984d16fed84c3b97e0c227753', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604d49df0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'15aba96b7d635b55becb40cd03d59ebf8787fb954f44373d92484155a011e174', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 19.313004970550537 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '35943' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:35943
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:15 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:16 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f656b3ef4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f656b3ef550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f656b3efca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd5d1304ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd5d1305040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd5d1305550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd5d13055e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd5d1305790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd5d1305820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd5d1305940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd5d13059d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd5d1305a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd5d1305af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd5d1305d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd5d1305e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd5d1305ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd5d1305dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 34825
INFO root:portable_runner.py:543 starting data server on port 43733
INFO root:portable_runner.py:543 starting state server on port 39079
INFO root:portable_runner.py:543 starting logging server on port 34917
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604c60a90> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'31ddeb9e19e0a2b2604d4e1a9a2a1ad4a4381c0c452bc71c8d5051e17b29316f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604c65fa0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f037e5fa8dcea5d8cb9bf8d9771179c2aa8e4a8c1cf865fdefd7e01d863efd49', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.17776870727539 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 269.74s (0:04:29) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 721381
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 722314.
Stopping expansion service pid: 722315.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 21s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/u5lkwdshjhzu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4857
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4857/display/redirect>
Changes:
------------------------------------------
[...truncated 1.50 MB...]
key: "vdheYaGEDFIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "vdheYaGEDFTimestampedValueCoder"
>
>
coders: <
key: "vdheYaGEDFKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vdheYaGEDFVarIntCoder"
component_coder_ids: "vdheYaGEDFRowCoder"
>
>
coders: <
key: "vdheYaGEDFKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vdheYaGEDFVarIntCoder"
component_coder_ids: "vdheYaGEDFTimestampedValueCoder"
>
>
coders: <
key: "vdheYaGEDFKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vdheYaGEDFVarIntCoder"
component_coder_ids: "vdheYaGEDFIterableCoder"
>
>
coders: <
key: "vdheYaGEDFRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$b565780b-d62a-4e12-83f5-e97023082b3f"
>
>
>
coders: <
key: "vdheYaGEDFTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000Q\253`#sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\271\215\273\014\237?#\027\210\212\034\306\r<A\201\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\000v\246\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "vdheYaGEDFVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "vdheYaGEDFVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "vdheYaGEDFbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar\022@a2b20831e98dc7a75c21457117f7405a629cf6e0cbc116bf0954972d2976fcc5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/23 23:20:27 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700781627375434833
2023/11/23 23:20:29 Prepared job with id: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487 and staging token: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487
2023/11/23 23:20:30 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487
2023/11/23 23:20:30 Submitted job: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487
2023/11/23 23:20:30 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: STOPPED
2023/11/23 23:20:30 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: STARTING
2023/11/23 23:20:30 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: RUNNING
2023/11/23 23:20:30 2023-11-23 23:20:30. (1): ==================== <function annotate_downstream_side_inputs at 0x7f282e185ee0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f282e186040> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (3): ==================== <function pack_combiners at 0x7f282e186550> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (4): ==================== <function lift_combiners at 0x7f282e1865e0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (5): ==================== <function expand_sdf at 0x7f282e186790> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (6): ==================== <function expand_gbk at 0x7f282e186820> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (7): ==================== <function sink_flattens at 0x7f282e186940> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (8): ==================== <function greedily_fuse at 0x7f282e1869d0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (9): ==================== <function read_to_impulse at 0x7f282e186a60> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (10): ==================== <function impulse_to_input at 0x7f282e186af0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (11): ==================== <function sort_stages at 0x7f282e186d30> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f282e186e50> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (13): ==================== <function setup_timer_mapping at 0x7f282e186ca0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (14): ==================== <function populate_data_channel_coders at 0x7f282e186dc0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (15): starting control server on port 39943
2023/11/23 23:20:30 2023-11-23 23:20:30. (16): starting data server on port 41447
2023/11/23 23:20:30 2023-11-23 23:20:30. (17): starting state server on port 36177
2023/11/23 23:20:30 2023-11-23 23:20:30. (18): starting logging server on port 44705
2023/11/23 23:20:30 2023-11-23 23:20:30. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2862b5fa60> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/23 23:20:30 2023-11-23 23:20:30. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/23 23:20:30 2023-11-23 23:20:30. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/23 23:20:36 2023-11-23 23:20:36. (22): Waiting for docker to start up. Current status is running
2023/11/23 23:20:36 2023-11-23 23:20:36. (23): Docker container is running. container_id = b'236d6cbf592bf1798203d898ea2b600f444f87c54d98349442bac344180aba67', worker_id = worker_16
2023/11/23 23:20:38 2023-11-23 23:20:37. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2862a4b970> for environment vdheYaGEDFbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/23 23:20:40 2023-11-23 23:20:40. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/23 23:20:41 2023-11-23 23:20:41. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/23 23:20:42 2023-11-23 23:20:42. (27): Waiting for docker to start up. Current status is running
2023/11/23 23:20:42 2023-11-23 23:20:42. (28): Docker container is running. container_id = b'7fc21c220900d454d662c46ed43524396e726d8d74985f2c8969488643bdb04e', worker_id = worker_18
2023/11/23 23:20:48 2023-11-23 23:20:48. (29): Completed job in 18.33408522605896 seconds with state DONE.
2023/11/23 23:20:48 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: DONE
2023/11/23 23:20:48 🐳 Terminating container: df0f23038c3f
2023/11/23 23:20:48 🚫 Container terminated: df0f23038c3f
--- PASS: TestJDBCIO_PostgresReadWrite (49.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 109.305s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33539
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpl0dms3x5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38731
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 18s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/x4we2cybk55fa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4856
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4856/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
component_coder_ids: "McrgpjzejnTimestampedValueCoder"
>
>
coders: <
key: "McrgpjzejnKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "McrgpjzejnVarIntCoder"
component_coder_ids: "McrgpjzejnIterableCoder"
>
>
coders: <
key: "McrgpjzejnRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$d9da51bc-0010-4ab0-a4cc-66c429331982"
>
>
>
coders: <
key: "McrgpjzejnTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\320*\277Bsr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\256\231\020\216\370\272\002~\t\361\260\252\343\"EN\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "McrgpjzejnVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "McrgpjzejnVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "Mcrgpjzejnbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar\022@a2b20831e98dc7a75c21457117f7405a629cf6e0cbc116bf0954972d2976fcc5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/23 17:20:45 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700760045696698531
2023/11/23 17:20:48 Prepared job with id: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9 and staging token: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9
2023/11/23 17:20:48 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9
2023/11/23 17:20:48 Submitted job: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9
2023/11/23 17:20:48 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: STOPPED
2023/11/23 17:20:48 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: STARTING
2023/11/23 17:20:48 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: RUNNING
2023/11/23 17:20:48 2023-11-23 17:20:48. (1): ==================== <function annotate_downstream_side_inputs at 0x7ff1a5eb1ee0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (2): ==================== <function fix_side_input_pcoll_coders at 0x7ff1a5eb3040> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (3): ==================== <function pack_combiners at 0x7ff1a5eb3550> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (4): ==================== <function lift_combiners at 0x7ff1a5eb35e0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (5): ==================== <function expand_sdf at 0x7ff1a5eb3790> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (6): ==================== <function expand_gbk at 0x7ff1a5eb3820> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (7): ==================== <function sink_flattens at 0x7ff1a5eb3940> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (8): ==================== <function greedily_fuse at 0x7ff1a5eb39d0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (9): ==================== <function read_to_impulse at 0x7ff1a5eb3a60> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (10): ==================== <function impulse_to_input at 0x7ff1a5eb3af0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (11): ==================== <function sort_stages at 0x7ff1a5eb3d30> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7ff1a5eb3e50> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (13): ==================== <function setup_timer_mapping at 0x7ff1a5eb3ca0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (14): ==================== <function populate_data_channel_coders at 0x7ff1a5eb3dc0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (15): starting control server on port 44937
2023/11/23 17:20:48 2023-11-23 17:20:48. (16): starting data server on port 42245
2023/11/23 17:20:48 2023-11-23 17:20:48. (17): starting state server on port 36665
2023/11/23 17:20:48 2023-11-23 17:20:48. (18): starting logging server on port 37021
2023/11/23 17:20:48 2023-11-23 17:20:48. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff1da8a50d0> for environment Mcrgpjzejnbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/23 17:20:52 2023-11-23 17:20:52. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/23 17:20:52 2023-11-23 17:20:52. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/23 17:20:53 2023-11-23 17:20:53. (22): Waiting for docker to start up. Current status is running
2023/11/23 17:20:53 2023-11-23 17:20:53. (23): Docker container is running. container_id = b'ee1a21ef8266dcdf3060ab2dff240fd41b451d2efce110dddfef5b3ebe6e7691', worker_id = worker_17
2023/11/23 17:20:54 2023-11-23 17:20:54. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff1a454d940> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/23 17:20:57 2023-11-23 17:20:57. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/23 17:20:57 2023-11-23 17:20:57. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/23 17:20:59 2023-11-23 17:20:59. (27): Waiting for docker to start up. Current status is running
2023/11/23 17:20:59 2023-11-23 17:20:59. (28): Docker container is running. container_id = b'5dc4b996a1f5989a20730e373d5e3c3d53dc670479129764a00b2c56e9faea4d', worker_id = worker_19
2023/11/23 17:21:02 2023-11-23 17:21:02. (29): Completed job in 14.0757315158844 seconds with state DONE.
2023/11/23 17:21:02 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: DONE
2023/11/23 17:21:02 🐳 Terminating container: 17c0868aca2c
2023/11/23 17:21:02 🚫 Container terminated: 17c0868aca2c
--- PASS: TestJDBCIO_PostgresReadWrite (43.62s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 123.198s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36507
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpv8xz5yvp/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 37413
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 19s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/mm65xazecjfyy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4855
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4855/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:41 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f81ea77d4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f81ea77d550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f81ea77dca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff204d09ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff204d0a040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff204d0a550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff204d0a5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff204d0a790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff204d0a820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff204d0a940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff204d0a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff204d0aa60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff204d0aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff204d0ad30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff204d0ae50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff204d0aca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff204d0adc0> ====================
INFO root:portable_runner.py:543 starting control server on port 36889
INFO root:portable_runner.py:543 starting data server on port 46873
INFO root:portable_runner.py:543 starting state server on port 45627
INFO root:portable_runner.py:543 starting logging server on port 41309
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff23899d910> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0a09c57a3f0a533e2bd5cb66de8a495b129ccb4ef45606d30b37e1991e68a9c4', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff238e16cd0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8c25aa4e542b1c029a4331be70db1129f417456588c54eb6adcbecf49a553bf0', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.951537847518921 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '34159' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:34159
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:06 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:07 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:07 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:08 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:10 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:11 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f81ea77d4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f81ea77d550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f81ea77dca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff204d09ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff204d0a040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff204d0a550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff204d0a5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff204d0a790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff204d0a820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff204d0a940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff204d0a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff204d0aa60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff204d0aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff204d0ad30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff204d0ae50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff204d0aca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff204d0adc0> ====================
INFO root:portable_runner.py:543 starting control server on port 45633
INFO root:portable_runner.py:543 starting data server on port 41845
INFO root:portable_runner.py:543 starting state server on port 44759
INFO root:portable_runner.py:543 starting logging server on port 38205
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff22c6f9670> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f6fb0c3daa31dd33473ae5a9a8d0b4e9b4813e6ad6313d8dd8f3f9feb8245671', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff2389c8430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3c3e82d4749240b6ec77c39dcb97ce58845e889775e67e8c7aab8b97f30973ab', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.224024534225464 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 255.55s (0:04:15) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3678450
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3682111.
Stopping expansion service pid: 3682112.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 11s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/tacodqbwvxd4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4854
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4854/display/redirect?page=changes>
Changes:
[noreply] revert protobuf version (#29523)
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:28 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:28 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:28 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:30 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:30 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:30 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6fc5b404c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6fc5b40550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6fc5b40ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4046f70ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4046f71040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4046f71550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4046f715e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4046f71790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4046f71820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4046f71940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4046f719d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4046f71a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4046f71af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4046f71d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4046f71e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4046f71ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4046f71dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 34607
INFO root:portable_runner.py:543 starting data server on port 37081
INFO root:portable_runner.py:543 starting state server on port 42547
INFO root:portable_runner.py:543 starting logging server on port 33463
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f406993e280> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7cd9a14db1ee5536dfc7e53c60179baa83228e499aab429a6e94245a63eda76d', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f407b5d4310> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'06f84c2c46aa76d641766c337d100f7f9b848309bde598be7d73f187c01dd6cc', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.59232497215271 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '60657' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:60657
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:55 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:56 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:56 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:56 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:58 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:38:00 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6fc5b404c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6fc5b40550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6fc5b40ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4046f70ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4046f71040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4046f71550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4046f715e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4046f71790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4046f71820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4046f71940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4046f719d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4046f71a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4046f71af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4046f71d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4046f71e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4046f71ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4046f71dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 40379
INFO root:portable_runner.py:543 starting data server on port 41167
INFO root:portable_runner.py:543 starting state server on port 35397
INFO root:portable_runner.py:543 starting logging server on port 33969
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f407b5a2dc0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'81074c72b749487d8dfad671d6adc1b2e5697fabf2b3ebf3a709e04753b1a802', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f407b5b3430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'51c65c50bf26aec589fce53aae1ed1b5a370d4622df70aa86e80fb6308a10355', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.00628137588501 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 266.10s (0:04:26) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3325350
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3325910.
Stopping expansion service pid: 3325911.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 4s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/u2kb25fcacn4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4853
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4853/display/redirect>
Changes:
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f00a55784c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f00a5578550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f00a5578ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f978f31dee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f978f31e040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f978f31e550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f978f31e5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f978f31e790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f978f31e820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f978f31e940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f978f31e9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f978f31ea60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f978f31eaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f978f31ed30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f978f31ee50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f978f31eca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f978f31edc0> ====================
INFO root:portable_runner.py:543 starting control server on port 39695
INFO root:portable_runner.py:543 starting data server on port 44899
INFO root:portable_runner.py:543 starting state server on port 34515
INFO root:portable_runner.py:543 starting logging server on port 45039
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c2cf8d60> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'508be959e1a376ca7d0ed6795b232410facd5d15974e78543eca91fe1e762cc8', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c2c914f0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0f38195ea8dcb4fb2796a40aeb55c921dc7aea59eb55713b7c25a8cc43ccffe5', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.07070016860962 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '46007' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:46007
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:09 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:12 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f00a55784c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f00a5578550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f00a5578ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f978f31dee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f978f31e040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f978f31e550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f978f31e5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f978f31e790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f978f31e820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f978f31e940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f978f31e9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f978f31ea60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f978f31eaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f978f31ed30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f978f31ee50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f978f31eca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f978f31edc0> ====================
INFO root:portable_runner.py:543 starting control server on port 34805
INFO root:portable_runner.py:543 starting data server on port 43277
INFO root:portable_runner.py:543 starting state server on port 38511
INFO root:portable_runner.py:543 starting logging server on port 36687
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c255a0d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a051a83092ec8c16aca5cf430d988da1ff23326fae15caf3f1d645dc4f80a279', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c256c550> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'282b30deaf040eaefc320fb252eebce4f09d26e3e5eadd8eec1f06941f54d47f', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.265949010848999 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 253.78s (0:04:13) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3063144
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3063661.
Stopping expansion service pid: 3063662.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 17s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/47yuc6iikbapg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4852
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4852/display/redirect?page=changes>
Changes:
[noreply] Bump grpc_version dependency (#29511)
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:54 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:54 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:54 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0cd435b4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0cd435b550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0cd435bca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fecd3445ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fecd3446040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fecd3446550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fecd34465e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fecd3446790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fecd3446820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fecd3446940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fecd34469d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fecd3446a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fecd3446af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fecd3446d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fecd3446e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fecd3446ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fecd3446dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 40443
INFO root:portable_runner.py:543 starting data server on port 40553
INFO root:portable_runner.py:543 starting state server on port 45339
INFO root:portable_runner.py:543 starting logging server on port 37073
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fed06c5d340> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3c4a85ef00026776fba1a4a887f79be5df33ed1972ade17ffd85ad8e5ba0d9d3', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fed06c4c970> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'99bd138c5672a877777ecc340867064b93141cc6a9e93c962fa8c030f3676ee3', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.158838272094727 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57251' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:57251
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:20 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:21 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:21 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:23 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:25 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0cd435b4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0cd435b550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0cd435bca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fecd3445ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fecd3446040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fecd3446550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fecd34465e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fecd3446790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fecd3446820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fecd3446940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fecd34469d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fecd3446a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fecd3446af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fecd3446d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fecd3446e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fecd3446ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fecd3446dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 33123
INFO root:portable_runner.py:543 starting data server on port 46149
INFO root:portable_runner.py:543 starting state server on port 37049
INFO root:portable_runner.py:543 starting logging server on port 37643
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fecd0322700> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bd727c25d290eb69afbae5d203dfe28867ca377439d68b8a727bff6d88b90f99', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fed06d55df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'570518015d8ce849dc43a22445aa5474ff40b2173c8a1f7671302dc534bfc3bc', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.534318923950195 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 294.28s (0:04:54) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1286195
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1300759.
Stopping expansion service pid: 1300760.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 32m 37s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/gykgrgsdzm5am
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4851
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4851/display/redirect>
Changes:
------------------------------------------
[...truncated 1.46 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:38 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:38 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:38 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f233a57f4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f233a57f550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f233a57fca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f7a16399ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f7a1639d040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f7a1639d550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f7a1639d5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f7a1639d790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f7a1639d820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f7a1639d940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f7a1639d9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f7a1639da60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f7a1639daf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f7a1639dd30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f7a1639de50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f7a1639dca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f7a1639ddc0> ====================
INFO root:portable_runner.py:543 starting control server on port 46587
INFO root:portable_runner.py:543 starting data server on port 36263
INFO root:portable_runner.py:543 starting state server on port 43279
INFO root:portable_runner.py:543 starting logging server on port 45111
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a4ac38c40> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0ccd903eb59ff87a0e65495054df6543df72fee507ebfbe3b6c7b3de3436941d', worker_id = worker_83
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a4ac3bd60> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'dfc882d5cf4f111c56b37098397d8766bdd65f85c9ec1b61bcf20e2151d90b8d', worker_id = worker_84
INFO root:portable_runner.py:543 Completed job in 14.920599222183228 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '42251' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:42251
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:02 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:05 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:07 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f233a57f4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f233a57f550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f233a57fca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f7a16399ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f7a1639d040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f7a1639d550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f7a1639d5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f7a1639d790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f7a1639d820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f7a1639d940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f7a1639d9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f7a1639da60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f7a1639daf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f7a1639dd30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f7a1639de50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f7a1639dca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f7a1639ddc0> ====================
INFO root:portable_runner.py:543 starting control server on port 43371
INFO root:portable_runner.py:543 starting data server on port 41747
INFO root:portable_runner.py:543 starting state server on port 44305
INFO root:portable_runner.py:543 starting logging server on port 43981
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a14211d00> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ad1fce7dbfa5788d89b39648c7901357eb0d733d48e319b1dfd668eb0f877f76', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a4ad7f9d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'5abfc847fc6e82b3b1c8efc394960e2ca87e252f5676a7820e6f0ec228646d28', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.166422843933105 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 255.96s (0:04:15) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1084026
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1090899.
Stopping expansion service pid: 1090900.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 7s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/vy5owd7backmk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4850
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4850/display/redirect>
Changes:
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:33 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:33 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:33 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f3bfbf634c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f3bfbf63550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f3bfbf63ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4d462f2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4d462f3040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4d462f3550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4d462f35e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4d462f3790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4d462f3820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4d462f3940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4d462f39d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4d462f3a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4d462f3af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4d462f3d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4d462f3e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4d462f3ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4d462f3dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 43069
INFO root:portable_runner.py:543 starting data server on port 40301
INFO root:portable_runner.py:543 starting state server on port 34345
INFO root:portable_runner.py:543 starting logging server on port 42763
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d74d72b80> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'755d188741e9b0297083954f9b39407778318d05acdea42bed4a5e449594d61b', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d74d81760> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e0e918964c8fedec1fc00851961cb1cdbab81759d04b1b13a84922e054b22401', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.209623575210571 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '48401' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:48401
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:57 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:58 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:58 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:59 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:38:01 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:38:03 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f3bfbf634c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f3bfbf63550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f3bfbf63ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4d462f2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4d462f3040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4d462f3550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4d462f35e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4d462f3790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4d462f3820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4d462f3940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4d462f39d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4d462f3a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4d462f3af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4d462f3d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4d462f3e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4d462f3ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4d462f3dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 46311
INFO root:portable_runner.py:543 starting data server on port 36027
INFO root:portable_runner.py:543 starting state server on port 44245
INFO root:portable_runner.py:543 starting logging server on port 43869
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d754d5ac0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f63983d1b0836f8921adb5841138eb1722ee059473d6e3014bce3a5cd40b6c02', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d74d7fa90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'db944a07d0231fb5e1803ce0407ead4dd53938f853a3de6e4c174401d51a0cc8', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.324472188949585 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 263.50s (0:04:23) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2173364
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2174350.
Stopping expansion service pid: 2174351.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 6s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/u3sxuy4ifmpd4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4849
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4849/display/redirect>
Changes:
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:44 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:45 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:45 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:47 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:47 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:47 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa3022e54c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa3022e5550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa3022e5ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4393d7cee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4393d80040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4393d80550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4393d805e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4393d80790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4393d80820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4393d80940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4393d809d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4393d80a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4393d80af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4393d80d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4393d80e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4393d80ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4393d80dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 35687
INFO root:portable_runner.py:543 starting data server on port 39621
INFO root:portable_runner.py:543 starting state server on port 43675
INFO root:portable_runner.py:543 starting logging server on port 43677
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c7f9cc40> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'9cc37708f451a5577660cc14636f0d7665400c02f42bd7e7982727c07b8ad7b4', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c86b7880> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4d2ab1928f718505e03ae247c29ef6b8c8cbac553a57d349e7a0e583f30e0a69', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.926170110702515 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '36903' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:36903
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:12 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:13 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:15 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:17 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa3022e54c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa3022e5550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa3022e5ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4393d7cee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4393d80040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4393d80550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4393d805e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4393d80790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4393d80820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4393d80940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4393d809d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4393d80a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4393d80af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4393d80d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4393d80e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4393d80ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4393d80dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 35731
INFO root:portable_runner.py:543 starting data server on port 34871
INFO root:portable_runner.py:543 starting state server on port 38865
INFO root:portable_runner.py:543 starting logging server on port 35385
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c867c9d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'92af847cb0a821701c14ce983598fecb4bccc3a3a6e0b97c37afc5a724f22658', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c774abb0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2d6599ad38ca89bc5b98eb2441f1ad76b42c3136d31037165d0d2920fb70589f', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.557689666748047 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 257.78s (0:04:17) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1883594
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1884137.
Stopping expansion service pid: 1884138.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 11s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/rynwhb6ogsuya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4848
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4848/display/redirect?page=changes>
Changes:
[noreply] Propagate correct boundedness when using multiple outputs (#29506)
------------------------------------------
[...truncated 1.19 MB...]
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "xGpNdeEnoMIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "xGpNdeEnoMTimestampedValueCoder"
>
>
coders: <
key: "xGpNdeEnoMKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "xGpNdeEnoMVarIntCoder"
component_coder_ids: "xGpNdeEnoMRowCoder"
>
>
coders: <
key: "xGpNdeEnoMKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "xGpNdeEnoMVarIntCoder"
component_coder_ids: "xGpNdeEnoMTimestampedValueCoder"
>
>
coders: <
key: "xGpNdeEnoMKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "xGpNdeEnoMVarIntCoder"
component_coder_ids: "xGpNdeEnoMIterableCoder"
>
>
coders: <
key: "xGpNdeEnoMRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$eabfbe9b-9905-4909-bd50-0caf7273adb4"
>
>
>
coders: <
key: "xGpNdeEnoMTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000GP\343Isr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\277\343X G\013\323\220\263\346\027/v\344F\215\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "xGpNdeEnoMVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "xGpNdeEnoMVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "xGpNdeEnoMbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar\022@61328e97dbd13bc44fdf177998efb0bc0216fd8bfd8f4c07c47b9d8665598d70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/21 17:23:14 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1700587394652766790
2023/11/21 17:23:17 Prepared job with id: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36 and staging token: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36
2023/11/21 17:23:17 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36
2023/11/21 17:23:17 Submitted job: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36
2023/11/21 17:23:17 2023-11-21 17:23:17. (6): ==================== <function expand_gbk at 0x7f60eaf0a8b0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (7): ==================== <function sink_flattens at 0x7f60eaf0a9d0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (8): ==================== <function greedily_fuse at 0x7f60eaf0aa60> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (9): ==================== <function read_to_impulse at 0x7f60eaf0aaf0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (10): ==================== <function impulse_to_input at 0x7f60eaf0ab80> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (11): ==================== <function sort_stages at 0x7f60eaf0adc0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f60eaf0aee0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (13): ==================== <function setup_timer_mapping at 0x7f60eaf0ad30> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (14): ==================== <function populate_data_channel_coders at 0x7f60eaf0ae50> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (15): starting control server on port 35511
2023/11/21 17:23:17 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: STOPPED
2023/11/21 17:23:17 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: STARTING
2023/11/21 17:23:17 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: RUNNING
2023/11/21 17:23:17 2023-11-21 17:23:17. (16): starting data server on port 41911
2023/11/21 17:23:17 2023-11-21 17:23:17. (17): starting state server on port 33529
2023/11/21 17:23:17 2023-11-21 17:23:17. (18): starting logging server on port 37277
2023/11/21 17:23:17 2023-11-21 17:23:17. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f611e907e50> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/21 17:23:17 2023-11-21 17:23:17. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/21 17:23:18 2023-11-21 17:23:18. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/21 17:23:24 2023-11-21 17:23:24. (22): Waiting for docker to start up. Current status is running
2023/11/21 17:23:24 2023-11-21 17:23:24. (23): Docker container is running. container_id = b'fbb3d06b38bc9b62d73fc5c8265889174b2d6e25d1103c1d3054336918c9e5be', worker_id = worker_14
2023/11/21 17:23:25 2023-11-21 17:23:25. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f611e899be0> for environment xGpNdeEnoMbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/21 17:23:28 2023-11-21 17:23:28. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/21 17:23:28 2023-11-21 17:23:28. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/21 17:23:29 2023-11-21 17:23:29. (27): Waiting for docker to start up. Current status is running
2023/11/21 17:23:29 2023-11-21 17:23:29. (28): Docker container is running. container_id = b'2e1535943c489487154294ae8f451d7f966b3a0d65a17cace606662c9c91bdfc', worker_id = worker_16
2023/11/21 17:23:36 2023-11-21 17:23:36. (29): Completed job in 18.324992656707764 seconds with state DONE.
2023/11/21 17:23:36 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: DONE
2023/11/21 17:23:36 🐳 Terminating container: 7fce9650c887
2023/11/21 17:23:36 🚫 Container terminated: 7fce9650c887
--- PASS: TestJDBCIO_PostgresReadWrite (55.07s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 156.415s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 46657
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpzbpe2b6x/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33463
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 31m 40s
261 actionable tasks: 176 executed, 75 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/yau7lz6jvrmze
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4847
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4847/display/redirect>
Changes:
------------------------------------------
[...truncated 1.37 MB...]
component_coder_ids: "SaPSArMhMbTimestampedValueCoder"
>
>
coders: <
key: "SaPSArMhMbKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "SaPSArMhMbVarIntCoder"
component_coder_ids: "SaPSArMhMbIterableCoder"
>
>
coders: <
key: "SaPSArMhMbRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$ffefa076-959f-4a4a-a2cd-912efcd15cba"
>
>
>
coders: <
key: "SaPSArMhMbTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\216\005\353\353sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\210b\347\026{\204d^\244~\033\334\341\332O\003\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "SaPSArMhMbVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "SaPSArMhMbVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "SaPSArMhMbbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar\022@61328e97dbd13bc44fdf177998efb0bc0216fd8bfd8f4c07c47b9d8665598d70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/21 11:21:02 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700565662969762051
2023/11/21 11:21:05 Prepared job with id: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa and staging token: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa
2023/11/21 11:21:06 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa
2023/11/21 11:21:06 Submitted job: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa
2023/11/21 11:21:06 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: STOPPED
2023/11/21 11:21:06 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: STARTING
2023/11/21 11:21:06 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: RUNNING
2023/11/21 11:21:06 2023-11-21 11:21:06. (1): ==================== <function annotate_downstream_side_inputs at 0x7fac3b0b9f70> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fac3b0bb0d0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (3): ==================== <function pack_combiners at 0x7fac3b0bb5e0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (4): ==================== <function lift_combiners at 0x7fac3b0bb670> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (5): ==================== <function expand_sdf at 0x7fac3b0bb820> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (6): ==================== <function expand_gbk at 0x7fac3b0bb8b0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (7): ==================== <function sink_flattens at 0x7fac3b0bb9d0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (8): ==================== <function greedily_fuse at 0x7fac3b0bba60> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (9): ==================== <function read_to_impulse at 0x7fac3b0bbaf0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (10): ==================== <function impulse_to_input at 0x7fac3b0bbb80> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (11): ==================== <function sort_stages at 0x7fac3b0bbdc0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fac3b0bbee0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (13): ==================== <function setup_timer_mapping at 0x7fac3b0bbd30> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (14): ==================== <function populate_data_channel_coders at 0x7fac3b0bbe50> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (15): starting control server on port 41389
2023/11/21 11:21:06 2023-11-21 11:21:06. (16): starting data server on port 43769
2023/11/21 11:21:06 2023-11-21 11:21:06. (17): starting state server on port 46101
2023/11/21 11:21:06 2023-11-21 11:21:06. (18): starting logging server on port 34621
2023/11/21 11:21:06 2023-11-21 11:21:06. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac6ebcde80> for environment SaPSArMhMbbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/21 11:21:06 2023-11-21 11:21:06. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/21 11:21:07 2023-11-21 11:21:07. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/21 11:21:09 2023-11-21 11:21:09. (22): Waiting for docker to start up. Current status is running
2023/11/21 11:21:09 2023-11-21 11:21:09. (23): Docker container is running. container_id = b'7c8761f3495337e854d16edc94b0d6f250d88c7836a198baf39dd042cf5137fd', worker_id = worker_17
2023/11/21 11:21:10 2023-11-21 11:21:10. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac6ebd4dc0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/21 11:21:13 2023-11-21 11:21:13. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/21 11:21:13 2023-11-21 11:21:13. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/21 11:21:15 2023-11-21 11:21:15. (27): Waiting for docker to start up. Current status is running
2023/11/21 11:21:15 2023-11-21 11:21:15. (28): Docker container is running. container_id = b'03fa67654c75d77b256cb1e0d0670933163d05c112ec59cc52c6d77b13c795ba', worker_id = worker_19
2023/11/21 11:21:18 2023-11-21 11:21:18. (29): Completed job in 12.29131531715393 seconds with state DONE.
2023/11/21 11:21:18 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: DONE
2023/11/21 11:21:18 🐳 Terminating container: 4b1717ccf670
2023/11/21 11:21:18 🚫 Container terminated: 4b1717ccf670
--- PASS: TestJDBCIO_PostgresReadWrite (37.99s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 122.502s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36383
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpsiysleot/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44733
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 46s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/zspelfnnt723a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4846
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4846/display/redirect>
Changes:
------------------------------------------
[...truncated 1.60 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:17 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:18 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:18 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb425d163a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb425d16430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb425d16b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8f03c9af70> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8f03c9b0d0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8f03c9b5e0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8f03c9b670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8f03c9b820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8f03c9b8b0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8f03c9b9d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8f03c9ba60> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8f03c9baf0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8f03c9bb80> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8f03c9bdc0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8f03c9bee0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8f03c9bd30> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8f03c9be50> ====================
INFO root:portable_runner.py:543 starting control server on port 33941
INFO root:portable_runner.py:543 starting data server on port 34281
INFO root:portable_runner.py:543 starting state server on port 33161
INFO root:portable_runner.py:543 starting logging server on port 41101
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f37002e80> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'64e4347247a7a7a6129e8f1b8bab51273b4aab9aefaf7c4a7c494a4f8882c864', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f370e2dc0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'427fef64563fe0dc2e2b432326832f7038b03e123f2d39c931ff05a6625875ac', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.83739447593689 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '60201' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:60201
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:43 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:44 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:47 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:48 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb425d163a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb425d16430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb425d16b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8f03c9af70> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8f03c9b0d0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8f03c9b5e0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8f03c9b670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8f03c9b820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8f03c9b8b0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8f03c9b9d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8f03c9ba60> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8f03c9baf0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8f03c9bb80> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8f03c9bdc0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8f03c9bee0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8f03c9bd30> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8f03c9be50> ====================
INFO root:portable_runner.py:543 starting control server on port 46505
INFO root:portable_runner.py:543 starting data server on port 33589
INFO root:portable_runner.py:543 starting state server on port 40537
INFO root:portable_runner.py:543 starting logging server on port 35133
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f370a5c70> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c58a1e4f7db05cb739f62fcfb14d88883f477eb4aca4ed86550ca561aee53541', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f37028820> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4f553941a7f10737ca5633657b4756ee867a2821d5e6a04533d650d7b137976a', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.574182748794556 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 253.36s (0:04:13) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 832206
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 833495.
Stopping expansion service pid: 833496.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 50s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/6jarvinw6nguk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4845
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4845/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:07 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:09 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:09 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:09 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f24609483a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f2460948430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f2460948b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4f683ecf70> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4f683ed0d0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4f683ed5e0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4f683ed670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4f683ed820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4f683ed8b0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4f683ed9d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4f683eda60> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4f683edaf0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4f683edb80> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4f683eddc0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4f683edee0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4f683edd30> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4f683ede50> ====================
INFO root:portable_runner.py:543 starting control server on port 41391
INFO root:portable_runner.py:543 starting data server on port 42673
INFO root:portable_runner.py:543 starting state server on port 36037
INFO root:portable_runner.py:543 starting logging server on port 36205
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4f9bc76400> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ac4a3cfe2d18fd354163f502ec35e398d1bc3de5bfe5e7aa5103db18ae7f0f77', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4f9bd7a730> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0b891a531f7b0bdbf0db34983a5e8e823081258a6c8e2d65f6144487489d7791', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.765973567962646 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '43265' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:43265
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:33 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:34 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:34 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:34 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:36 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 11:38:38 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f24609483a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f2460948430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f2460948b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4f683ecf70> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4f683ed0d0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4f683ed5e0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4f683ed670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4f683ed820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4f683ed8b0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4f683ed9d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4f683eda60> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4f683edaf0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4f683edb80> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4f683eddc0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4f683edee0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4f683edd30> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4f683ede50> ====================
INFO root:portable_runner.py:543 starting control server on port 33201
INFO root:portable_runner.py:543 starting data server on port 34941
INFO root:portable_runner.py:543 starting state server on port 43249
INFO root:portable_runner.py:543 starting logging server on port 39249
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4f9bc89550> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bc7b60c53cba976704ab657c99d00d0c0672a19e2951cbdd241a1587bd72505c', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4f96d7fdc0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'462766e584dad09300f2145770ceed3e2da9eb1ffa4b60218f4d33a0506d4ade', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 17.625015258789062 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 259.80s (0:04:19) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 520990
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 527420.
Stopping expansion service pid: 527421.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 43s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/7hdqcx2iuvr3s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4844
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4844/display/redirect?page=changes>
Changes:
[noreply] Bump golang.org/x/net from 0.17.0 to 0.18.0 in /sdks (#29464)
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:19 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:19 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:20 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:22 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:22 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f9dad14d280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f9dad14d310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f9dad14da60> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f7b69fabe50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f7b69fabf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f7b69fac4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f7b69fac550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f7b69fac700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f7b69fac790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f7b69fac8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f7b69fac940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f7b69fac9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f7b69faca60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f7b69facca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f7b69facdc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f7b69facc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f7b69facd30> ====================
INFO root:portable_runner.py:543 starting control server on port 35329
INFO root:portable_runner.py:543 starting data server on port 40113
INFO root:portable_runner.py:543 starting state server on port 42049
INFO root:portable_runner.py:543 starting logging server on port 39661
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7b9e1c8640> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0e403c8968813f6950348485c1be295f935ee74360063641f2fe49cade802127', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7b9e84b4f0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd7c0bcb4a9fed041b7ec6ef75303afbaea8ab67abed28183f2880f606592e307', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.86998987197876 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '44033' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:44033
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:47 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:49 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:49 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:49 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:51 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 20, 2023 5:39:53 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f9dad14d280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f9dad14d310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f9dad14da60> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f7b69fabe50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f7b69fabf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f7b69fac4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f7b69fac550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f7b69fac700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f7b69fac790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f7b69fac8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f7b69fac940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f7b69fac9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f7b69faca60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f7b69facca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f7b69facdc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f7b69facc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f7b69facd30> ====================
INFO root:portable_runner.py:543 starting control server on port 37929
INFO root:portable_runner.py:543 starting data server on port 39895
INFO root:portable_runner.py:543 starting state server on port 41821
INFO root:portable_runner.py:543 starting logging server on port 39795
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7b9e1f51c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4d24890085b9775b52662037bee364b910d7b4bcdefd15464361a6c99f1f89eb', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7b9d980fd0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8f79f3298e309ff74f65ee85af59de0ef8685742133250c76cfd707e1ac5d52a', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 17.91416096687317 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 270.54s (0:04:30) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 254600
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 255310.
Stopping expansion service pid: 255311.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 54s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/b4rukm2ysrxog
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4843
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4843/display/redirect>
Changes:
------------------------------------------
[...truncated 1.36 MB...]
component_coder_ids: "TJwCeqPPWlTimestampedValueCoder"
>
>
coders: <
key: "TJwCeqPPWlKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "TJwCeqPPWlVarIntCoder"
component_coder_ids: "TJwCeqPPWlIterableCoder"
>
>
coders: <
key: "TJwCeqPPWlRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$8350f85c-3104-4f95-ae8c-f903fbda0614"
>
>
>
coders: <
key: "TJwCeqPPWlTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\260\375\242\022sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\213\211sz\205,\007\017S7\231\222l\224H\245\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "TJwCeqPPWlVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "TJwCeqPPWlVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "TJwCeqPPWlbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar\022@16f4d405e0bafbaaca81d9b18102cf6f71956da1794415e845b77b2c31e923ac"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/20 11:21:17 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700479277327926285
2023/11/20 11:21:19 Prepared job with id: go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6 and staging token: go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6
2023/11/20 11:21:20 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6
2023/11/20 11:21:20 Submitted job: go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6
2023/11/20 11:21:20 2023-11-20 11:21:20. (1): ==================== <function annotate_downstream_side_inputs at 0x7fb9301ece50> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fb9301ecf70> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (3): ==================== <function pack_combiners at 0x7fb9301ed4c0> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (4): ==================== <function lift_combiners at 0x7fb9301ed550> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (5): ==================== <function expand_sdf at 0x7fb9301ed700> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (6): ==================== <function expand_gbk at 0x7fb9301ed790> ====================
2023/11/20 11:21:20 Job[go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6] state: STOPPED
2023/11/20 11:21:20 Job[go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6] state: STARTING
2023/11/20 11:21:20 Job[go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6] state: RUNNING
2023/11/20 11:21:20 2023-11-20 11:21:20. (7): ==================== <function sink_flattens at 0x7fb9301ed8b0> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (8): ==================== <function greedily_fuse at 0x7fb9301ed940> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (9): ==================== <function read_to_impulse at 0x7fb9301ed9d0> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (10): ==================== <function impulse_to_input at 0x7fb9301eda60> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (11): ==================== <function sort_stages at 0x7fb9301edca0> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fb9301eddc0> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (13): ==================== <function setup_timer_mapping at 0x7fb9301edc10> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (14): ==================== <function populate_data_channel_coders at 0x7fb9301edd30> ====================
2023/11/20 11:21:20 2023-11-20 11:21:20. (15): starting control server on port 36751
2023/11/20 11:21:20 2023-11-20 11:21:20. (16): starting data server on port 42619
2023/11/20 11:21:20 2023-11-20 11:21:20. (17): starting state server on port 36259
2023/11/20 11:21:20 2023-11-20 11:21:20. (18): starting logging server on port 45101
2023/11/20 11:21:20 2023-11-20 11:21:20. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb96433a520> for environment TJwCeqPPWlbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/20 11:21:23 2023-11-20 11:21:23. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/20 11:21:23 2023-11-20 11:21:23. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/20 11:21:24 2023-11-20 11:21:24. (22): Waiting for docker to start up. Current status is running
2023/11/20 11:21:24 2023-11-20 11:21:24. (23): Docker container is running. container_id = b'0d5ef85e84e84ae5778d6ad366dbcf4f396bf2a8970fe8e3ea2e841f62ec1435', worker_id = worker_17
2023/11/20 11:21:26 2023-11-20 11:21:26. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb96433ff10> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/20 11:21:28 2023-11-20 11:21:28. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/20 11:21:28 2023-11-20 11:21:28. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/20 11:21:30 2023-11-20 11:21:30. (27): Waiting for docker to start up. Current status is running
2023/11/20 11:21:30 2023-11-20 11:21:30. (28): Docker container is running. container_id = b'dc81fc103c7fcbcdab96fdcb2d49ea411144b6f113a17d68853f094d6cf5f2e0', worker_id = worker_19
2023/11/20 11:21:33 2023-11-20 11:21:33. (29): Completed job in 13.456552743911743 seconds with state DONE.
2023/11/20 11:21:33 Job[go-testjdbcio_postgresreadwrite-781-7d64e838-d837-426f-bfb4-a3d41f2684b6] state: DONE
2023/11/20 11:21:33 🐳 Terminating container: 0d4fe4ef720f
2023/11/20 11:21:34 🚫 Container terminated: 0d4fe4ef720f
--- PASS: TestJDBCIO_PostgresReadWrite (39.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 125.438s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33789
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpsa189fge/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43795
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 42s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/nljtoxpx4dpmw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4842
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4842/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
key: "jVUvvCYYUHIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "jVUvvCYYUHTimestampedValueCoder"
>
>
coders: <
key: "jVUvvCYYUHKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "jVUvvCYYUHVarIntCoder"
component_coder_ids: "jVUvvCYYUHRowCoder"
>
>
coders: <
key: "jVUvvCYYUHKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "jVUvvCYYUHVarIntCoder"
component_coder_ids: "jVUvvCYYUHTimestampedValueCoder"
>
>
coders: <
key: "jVUvvCYYUHKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "jVUvvCYYUHVarIntCoder"
component_coder_ids: "jVUvvCYYUHIterableCoder"
>
>
coders: <
key: "jVUvvCYYUHRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$574b28dd-a5ad-4f73-b2e4-66cd41dde73c"
>
>
>
coders: <
key: "jVUvvCYYUHTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000g\255\345_sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\2706\224\003;\260\\)\365n\330O\216gG=\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "jVUvvCYYUHVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "jVUvvCYYUHVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "jVUvvCYYUHbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar\022@16f4d405e0bafbaaca81d9b18102cf6f71956da1794415e845b77b2c31e923ac"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/20 05:21:08 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700457668937465638
2023/11/20 05:21:11 Prepared job with id: go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366 and staging token: go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366
2023/11/20 05:21:11 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366
2023/11/20 05:21:11 Submitted job: go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366
2023/11/20 05:21:11 Job[go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366] state: STOPPED
2023/11/20 05:21:11 Job[go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366] state: STARTING
2023/11/20 05:21:11 Job[go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366] state: RUNNING
2023/11/20 05:21:11 2023-11-20 05:21:11. (1): ==================== <function annotate_downstream_side_inputs at 0x7f2529b34e50> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f2529b34f70> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (3): ==================== <function pack_combiners at 0x7f2529b354c0> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (4): ==================== <function lift_combiners at 0x7f2529b35550> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (5): ==================== <function expand_sdf at 0x7f2529b35700> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (6): ==================== <function expand_gbk at 0x7f2529b35790> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (7): ==================== <function sink_flattens at 0x7f2529b358b0> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (8): ==================== <function greedily_fuse at 0x7f2529b35940> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (9): ==================== <function read_to_impulse at 0x7f2529b359d0> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (10): ==================== <function impulse_to_input at 0x7f2529b35a60> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (11): ==================== <function sort_stages at 0x7f2529b35ca0> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f2529b35dc0> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (13): ==================== <function setup_timer_mapping at 0x7f2529b35c10> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (14): ==================== <function populate_data_channel_coders at 0x7f2529b35d30> ====================
2023/11/20 05:21:11 2023-11-20 05:21:11. (15): starting control server on port 46037
2023/11/20 05:21:11 2023-11-20 05:21:11. (16): starting data server on port 39421
2023/11/20 05:21:11 2023-11-20 05:21:11. (17): starting state server on port 37535
2023/11/20 05:21:11 2023-11-20 05:21:11. (18): starting logging server on port 33425
2023/11/20 05:21:11 2023-11-20 05:21:11. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f255e4f6790> for environment jVUvvCYYUHbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/20 05:21:15 2023-11-20 05:21:15. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/20 05:21:16 2023-11-20 05:21:16. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/20 05:21:17 2023-11-20 05:21:17. (22): Waiting for docker to start up. Current status is running
2023/11/20 05:21:17 2023-11-20 05:21:17. (23): Docker container is running. container_id = b'c56f3e62943d59982e1d90d5c9e7c87d42e6342373dc5a1c83ef54dc82c704a8', worker_id = worker_17
2023/11/20 05:21:18 2023-11-20 05:21:18. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f255e495fa0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/20 05:21:20 2023-11-20 05:21:20. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/20 05:21:21 2023-11-20 05:21:21. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/20 05:21:22 2023-11-20 05:21:22. (27): Waiting for docker to start up. Current status is running
2023/11/20 05:21:22 2023-11-20 05:21:22. (28): Docker container is running. container_id = b'57a9b62475e036a0c50af71597d83d9237be7a7cb46b98d621cb3ab13385d092', worker_id = worker_19
2023/11/20 05:21:26 2023-11-20 05:21:26. (29): Completed job in 14.326693534851074 seconds with state DONE.
2023/11/20 05:21:26 Job[go-testjdbcio_postgresreadwrite-440-dc4d48f0-b6ce-4a4b-b649-a738fa96d366] state: DONE
2023/11/20 05:21:26 🐳 Terminating container: e9f847fa85c9
2023/11/20 05:21:26 🚫 Container terminated: e9f847fa85c9
--- PASS: TestJDBCIO_PostgresReadWrite (40.86s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 124.564s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43035
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpo0r97u3m/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35975
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 7s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wmm5uflcgw7ac
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4841
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4841/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
component_coder_ids: "HHRxYseAtZTimestampedValueCoder"
>
>
coders: <
key: "HHRxYseAtZKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "HHRxYseAtZVarIntCoder"
component_coder_ids: "HHRxYseAtZIterableCoder"
>
>
coders: <
key: "HHRxYseAtZRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$e16bd8e4-1ffd-40e9-994c-795829382ae2"
>
>
>
coders: <
key: "HHRxYseAtZTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\234\304\364\374sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\222Za\374\244\367\305\322\361\2370\213\037=C&\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "HHRxYseAtZVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "HHRxYseAtZVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "HHRxYseAtZbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar\022@16f4d405e0bafbaaca81d9b18102cf6f71956da1794415e845b77b2c31e923ac"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/19 23:20:14 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700436014561614456
2023/11/19 23:20:17 Prepared job with id: go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee and staging token: go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee
2023/11/19 23:20:17 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee
2023/11/19 23:20:17 Submitted job: go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee
2023/11/19 23:20:17 Job[go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee] state: STOPPED
2023/11/19 23:20:17 Job[go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee] state: STARTING
2023/11/19 23:20:17 Job[go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee] state: RUNNING
2023/11/19 23:20:17 2023-11-19 23:20:17. (1): ==================== <function annotate_downstream_side_inputs at 0x7f6ba0eede50> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f6ba0eedf70> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (3): ==================== <function pack_combiners at 0x7f6ba0eee4c0> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (4): ==================== <function lift_combiners at 0x7f6ba0eee550> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (5): ==================== <function expand_sdf at 0x7f6ba0eee700> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (6): ==================== <function expand_gbk at 0x7f6ba0eee790> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (7): ==================== <function sink_flattens at 0x7f6ba0eee8b0> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (8): ==================== <function greedily_fuse at 0x7f6ba0eee940> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (9): ==================== <function read_to_impulse at 0x7f6ba0eee9d0> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (10): ==================== <function impulse_to_input at 0x7f6ba0eeea60> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (11): ==================== <function sort_stages at 0x7f6ba0eeeca0> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f6ba0eeedc0> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (13): ==================== <function setup_timer_mapping at 0x7f6ba0eeec10> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (14): ==================== <function populate_data_channel_coders at 0x7f6ba0eeed30> ====================
2023/11/19 23:20:17 2023-11-19 23:20:17. (15): starting control server on port 46215
2023/11/19 23:20:17 2023-11-19 23:20:17. (16): starting data server on port 44561
2023/11/19 23:20:17 2023-11-19 23:20:17. (17): starting state server on port 34171
2023/11/19 23:20:17 2023-11-19 23:20:17. (18): starting logging server on port 38641
2023/11/19 23:20:17 2023-11-19 23:20:17. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6bd50b8100> for environment HHRxYseAtZbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/19 23:20:20 2023-11-19 23:20:20. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/19 23:20:21 2023-11-19 23:20:21. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/19 23:20:22 2023-11-19 23:20:22. (22): Waiting for docker to start up. Current status is running
2023/11/19 23:20:22 2023-11-19 23:20:22. (23): Docker container is running. container_id = b'ee20f38d40a38f2dc799a70c1c64f798b72a145cde0a933c21dd4f8ee3fc874e', worker_id = worker_15
2023/11/19 23:20:23 2023-11-19 23:20:23. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6b9cdca0a0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/19 23:20:25 2023-11-19 23:20:25. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/19 23:20:26 2023-11-19 23:20:26. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/19 23:20:27 2023-11-19 23:20:27. (27): Waiting for docker to start up. Current status is running
2023/11/19 23:20:27 2023-11-19 23:20:27. (28): Docker container is running. container_id = b'1a57eb1d57d97af6ed04474f168a3f3428db567643617be456297424a434e7b0', worker_id = worker_17
2023/11/19 23:20:32 2023-11-19 23:20:32. (29): Completed job in 14.87870454788208 seconds with state DONE.
2023/11/19 23:20:32 Job[go-testjdbcio_postgresreadwrite-411-9bd446a9-9363-4571-b528-96bbb0ca15ee] state: DONE
2023/11/19 23:20:32 🐳 Terminating container: fb0e0e21d25e
2023/11/19 23:20:32 🚫 Container terminated: fb0e0e21d25e
--- PASS: TestJDBCIO_PostgresReadWrite (43.75s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 95.225s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36329
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpcv9i83ni/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44013
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 33s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/aooesv44vn2fs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4840
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4840/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:36:40 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:36:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:36:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:36:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:36:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:36:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f46b04caaf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f46b04cab80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f46b04cb310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f05ef8cbe50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f05ef8cbf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f05ef8cc4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f05ef8cc550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f05ef8cc700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f05ef8cc790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f05ef8cc8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f05ef8cc940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f05ef8cc9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f05ef8cca60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f05ef8ccca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f05ef8ccdc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f05ef8ccc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f05ef8ccd30> ====================
INFO root:portable_runner.py:543 starting control server on port 42109
INFO root:portable_runner.py:543 starting data server on port 33483
INFO root:portable_runner.py:543 starting state server on port 44535
INFO root:portable_runner.py:543 starting logging server on port 42549
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0622de5a00> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'6fba578a593d68c57d55d495573e237e1fca4ea8b9e27f344630938b296e7851', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0622dcc250> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'969db5843eee73c41599f9d39635ef1c1a526c5c535b0185e90e3631fe76d2a1', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.488040924072266 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '59737' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:59737
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:05 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:09 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:10 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f46b04caaf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f46b04cab80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f46b04cb310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f05ef8cbe50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f05ef8cbf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f05ef8cc4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f05ef8cc550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f05ef8cc700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f05ef8cc790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f05ef8cc8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f05ef8cc940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f05ef8cc9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f05ef8cca60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f05ef8ccca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f05ef8ccdc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f05ef8ccc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f05ef8ccd30> ====================
INFO root:portable_runner.py:543 starting control server on port 44447
INFO root:portable_runner.py:543 starting data server on port 44441
INFO root:portable_runner.py:543 starting state server on port 46353
INFO root:portable_runner.py:543 starting logging server on port 40313
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f06242ae760> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b9c346429029893167a56842b3688dda5c934454680ef92149580addc627c846', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0624276df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bf39fbe1d39902d9e0862b273602988845d8971b3c2d0785da6c0979c008587c', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.871635437011719 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 247.46s (0:04:07) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3561606
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3562138.
Stopping expansion service pid: 3562139.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 12s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/4xaluwsxmn2d4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4839
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4839/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:13 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:13 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:13 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f8c59e9caf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f8c59e9cb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f8c59e9d310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f398acd6e50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f398acd6f70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f398acd74c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f398acd7550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f398acd7700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f398acd7790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f398acd78b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f398acd7940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f398acd79d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f398acd7a60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f398acd7ca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f398acd7dc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f398acd7c10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f398acd7d30> ====================
INFO root:portable_runner.py:543 starting control server on port 38891
INFO root:portable_runner.py:543 starting data server on port 37329
INFO root:portable_runner.py:543 starting state server on port 46105
INFO root:portable_runner.py:543 starting logging server on port 33717
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f39bf164370> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e19290fb202a76dd04fdc19f1dd4680f58d068b57e1c941afa711b959043c23b', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f39bf15e910> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e05eb1fb1f738c54255763aa392e435dde316b7c56aeb46a8b265983a90cabfd', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.474752426147461 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '52003' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:52003
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:37 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:37 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:37 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:39 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 11:37:41 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f8c59e9caf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f8c59e9cb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f8c59e9d310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f398acd6e50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f398acd6f70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f398acd74c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f398acd7550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f398acd7700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f398acd7790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f398acd78b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f398acd7940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f398acd79d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f398acd7a60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f398acd7ca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f398acd7dc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f398acd7c10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f398acd7d30> ====================
INFO root:portable_runner.py:543 starting control server on port 41401
INFO root:portable_runner.py:543 starting data server on port 38339
INFO root:portable_runner.py:543 starting state server on port 38749
INFO root:portable_runner.py:543 starting logging server on port 36877
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f39bf0ccca0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'341c831a5eb60b246d5a0cf8c31a73e9ea323b9a7c99cf32c8d90b7ca714a0ba', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f39bf0d1100> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'334e36f27d3ae6076df7f77c55d691f89097e07c209afc96a7fa47779ddc072f', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.36143708229065 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 254.96s (0:04:14) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3339169
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3339834.
Stopping expansion service pid: 3339835.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 45s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/jeprekoogovpo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4838
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4838/display/redirect>
Changes:
------------------------------------------
[...truncated 1.57 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:03 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:03 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:04 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:05 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:06 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:06 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f38b4c7caf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f38b4c7cb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f38b4c81310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc10fdcce50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc10fdccf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc10fdcd4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc10fdcd550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc10fdcd700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc10fdcd790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc10fdcd8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc10fdcd940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc10fdcd9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc10fdcda60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc10fdcdca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc10fdcddc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc10fdcdc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc10fdcdd30> ====================
INFO root:portable_runner.py:543 starting control server on port 34901
INFO root:portable_runner.py:543 starting data server on port 44909
INFO root:portable_runner.py:543 starting state server on port 40113
INFO root:portable_runner.py:543 starting logging server on port 39705
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc141617b20> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'05b785b8d1f0a323bb99ce4989c91b9d1968c3cdb7e735ddb70472980a7b5dce', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc141639100> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cd8a632260a88d222a7dcab0e7e2842aadb71d12eb1ad818f65998274f0824a7', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 21.06672167778015 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '39887' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:39887
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:37 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:37 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:37 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:39 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 19, 2023 5:37:41 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f38b4c7caf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f38b4c7cb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f38b4c81310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc10fdcce50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc10fdccf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc10fdcd4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc10fdcd550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc10fdcd700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc10fdcd790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc10fdcd8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc10fdcd940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc10fdcd9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc10fdcda60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc10fdcdca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc10fdcddc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc10fdcdc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc10fdcdd30> ====================
INFO root:portable_runner.py:543 starting control server on port 38335
INFO root:portable_runner.py:543 starting data server on port 35219
INFO root:portable_runner.py:543 starting state server on port 34603
INFO root:portable_runner.py:543 starting logging server on port 33247
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc14163c880> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e8b3e083998c714435347723a5bbfce3f4db7a709d7a4eb7826405631a5cea22', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc141617df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'867f3897292ddaac10f8d12d31fe3c7973c0b6f149f0166c781796480f602aee', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.015408992767334 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 264.09s (0:04:24) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3092382
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3093154.
Stopping expansion service pid: 3093155.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 45s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/r6vma2qoxn5lg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4837
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4837/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:36049.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:41:35 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:41:35 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:41:35 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:41:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:41:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:41:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fda9695baf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fda9695bb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fda9695c310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe6f3787e50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe6f3787f70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe6f37884c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe6f3788550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe6f3788700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe6f3788790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe6f37888b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe6f3788940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe6f37889d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe6f3788a60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe6f3788ca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe6f3788dc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe6f3788c10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe6f3788d30> ====================
INFO root:portable_runner.py:543 starting control server on port 41097
INFO root:portable_runner.py:543 starting data server on port 40511
INFO root:portable_runner.py:543 starting state server on port 35853
INFO root:portable_runner.py:543 starting logging server on port 42523
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe726d4d9a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b393684a92f49b23b7d7c1a166af53427c17762ea443aa998f657617ec4594ff', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe726d49310> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'909733f2f26774843dfa0990f05195ec9b4d54e13ea4904ee15706dc4828f0b6', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 19.702896118164062 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '38213' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:38213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:42:10 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:38213.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:42:13 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:42:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:42:14 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:42:17 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 11:42:19 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fda9695baf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fda9695bb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fda9695c310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe6f3787e50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe6f3787f70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe6f37884c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe6f3788550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe6f3788700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe6f3788790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe6f37888b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe6f3788940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe6f37889d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe6f3788a60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe6f3788ca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe6f3788dc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe6f3788c10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe6f3788d30> ====================
INFO root:portable_runner.py:543 starting control server on port 42319
INFO root:portable_runner.py:543 starting data server on port 34123
INFO root:portable_runner.py:543 starting state server on port 40821
INFO root:portable_runner.py:543 starting logging server on port 44565
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe72813a070> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4f135994ecc16e51f4ec04e996bc0d78d08fdc2740f66cf918e2a1f0fe85c940', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe726d42e20> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a4840f70da8c64a938af9360e5fe23705314b82d832cc650b5017b12215d7fe5', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 21.93160319328308 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 342.96s (0:05:42) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2551223
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2551881.
Stopping expansion service pid: 2551882.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 32m 33s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/kvqnrzt4kcc5s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4836
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4836/display/redirect>
Changes:
------------------------------------------
[...truncated 1.74 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:39:33 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:39:33 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:39:33 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:39:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:39:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:39:36 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f17fa5b6af0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f17fa5b6b80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f17fa5b7310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f9f2a4dce50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f9f2a4dcf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f9f2a4dd4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f9f2a4dd550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f9f2a4dd700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f9f2a4dd790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f9f2a4dd8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f9f2a4dd940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f9f2a4dd9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f9f2a4dda60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f9f2a4ddca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f9f2a4dddc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f9f2a4ddc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f9f2a4ddd30> ====================
INFO root:portable_runner.py:543 starting control server on port 35327
INFO root:portable_runner.py:543 starting data server on port 42901
INFO root:portable_runner.py:543 starting state server on port 37829
INFO root:portable_runner.py:543 starting logging server on port 34839
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9f5e7e3520> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'69dac04c4fc0c9435bb61869ea25b37d08e2b955697754368088c87f0d0ab541', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9f5e7fad90> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e997ff6df86c15815ec088b63676be8bc3f01a38b1f0c26084759eafab610e90', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 16.732646226882935 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57425' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:57425
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:40:02 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:40:03 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:40:03 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:40:04 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:40:06 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 18, 2023 5:40:08 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f17fa5b6af0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f17fa5b6b80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f17fa5b7310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f9f2a4dce50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f9f2a4dcf70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f9f2a4dd4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f9f2a4dd550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f9f2a4dd700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f9f2a4dd790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f9f2a4dd8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f9f2a4dd940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f9f2a4dd9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f9f2a4dda60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f9f2a4ddca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f9f2a4dddc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f9f2a4ddc10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f9f2a4ddd30> ====================
INFO root:portable_runner.py:543 starting control server on port 44523
INFO root:portable_runner.py:543 starting data server on port 39421
INFO root:portable_runner.py:543 starting state server on port 34779
INFO root:portable_runner.py:543 starting logging server on port 46193
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9f5ee74970> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'47ef361ec0bff71c63e71faa27651d96b951e561bdf8d79424a50d62b6b70f0f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9f5eed9e50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'9c7b8546936b711d7e26baf88804dbbc44136e8f5a44e0f882e2db46fbda103c', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.329439401626587 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 280.42s (0:04:40) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1928042
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1928726.
Stopping expansion service pid: 1928727.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 30m 8s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/3rb3czlaaolxi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4835
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4835/display/redirect>
Changes:
------------------------------------------
[...truncated 1.36 MB...]
component_coder_ids: "YZWBlZsgGyTimestampedValueCoder"
>
>
coders: <
key: "YZWBlZsgGyKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "YZWBlZsgGyVarIntCoder"
component_coder_ids: "YZWBlZsgGyIterableCoder"
>
>
coders: <
key: "YZWBlZsgGyRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$9baf9ecd-1b31-4ccc-b39d-ea76b47df390"
>
>
>
coders: <
key: "YZWBlZsgGyTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006j\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000(UUID;xp\000:)6!\240\000\021\001\344\000.\001\344\360L.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_idsr\000\tWdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\235\002\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225a(\020.Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\223\000/\264\352\017c\330\216`\255B\331%K'\005e\010\014srVo\001\205\366\004s.\001\313\000Dm\3570ors$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "YZWBlZsgGyVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "YZWBlZsgGyVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "YZWBlZsgGybeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar\022@16f4d405e0bafbaaca81d9b18102cf6f71956da1794415e845b77b2c31e923ac"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/18 11:20:54 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700306454349439586
2023/11/18 11:20:56 Prepared job with id: go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0 and staging token: go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0
2023/11/18 11:20:57 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0
2023/11/18 11:20:57 Submitted job: go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0
2023/11/18 11:20:57 Job[go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0] state: STOPPED
2023/11/18 11:20:57 Job[go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0] state: STARTING
2023/11/18 11:20:57 Job[go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0] state: RUNNING
2023/11/18 11:20:57 2023-11-18 11:20:57. (1): ==================== <function annotate_downstream_side_inputs at 0x7fac2fb41e50> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fac2fb41f70> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (3): ==================== <function pack_combiners at 0x7fac2fb424c0> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (4): ==================== <function lift_combiners at 0x7fac2fb42550> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (5): ==================== <function expand_sdf at 0x7fac2fb42700> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (6): ==================== <function expand_gbk at 0x7fac2fb42790> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (7): ==================== <function sink_flattens at 0x7fac2fb428b0> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (8): ==================== <function greedily_fuse at 0x7fac2fb42940> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (9): ==================== <function read_to_impulse at 0x7fac2fb429d0> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (10): ==================== <function impulse_to_input at 0x7fac2fb42a60> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (11): ==================== <function sort_stages at 0x7fac2fb42ca0> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fac2fb42dc0> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (13): ==================== <function setup_timer_mapping at 0x7fac2fb42c10> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (14): ==================== <function populate_data_channel_coders at 0x7fac2fb42d30> ====================
2023/11/18 11:20:57 2023-11-18 11:20:57. (15): starting control server on port 43617
2023/11/18 11:20:57 2023-11-18 11:20:57. (16): starting data server on port 34207
2023/11/18 11:20:57 2023-11-18 11:20:57. (17): starting state server on port 36777
2023/11/18 11:20:57 2023-11-18 11:20:57. (18): starting logging server on port 40537
2023/11/18 11:20:57 2023-11-18 11:20:57. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac644d0c40> for environment YZWBlZsgGybeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/18 11:21:00 2023-11-18 11:21:00. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/18 11:21:00 2023-11-18 11:21:00. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/18 11:21:02 2023-11-18 11:21:02. (22): Waiting for docker to start up. Current status is running
2023/11/18 11:21:02 2023-11-18 11:21:02. (23): Docker container is running. container_id = b'21083d3f23ee5ab7c6a160cff5a12fa2c5e8e5aa3ba1d06a64086602fca286ac', worker_id = worker_17
2023/11/18 11:21:03 2023-11-18 11:21:03. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac644e2940> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/18 11:21:05 2023-11-18 11:21:05. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/18 11:21:05 2023-11-18 11:21:05. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/18 11:21:07 2023-11-18 11:21:07. (27): Waiting for docker to start up. Current status is running
2023/11/18 11:21:07 2023-11-18 11:21:07. (28): Docker container is running. container_id = b'7e776ce4ba6e85e191124a815010f203da058d0f125df524c97e0468b6808471', worker_id = worker_19
2023/11/18 11:21:10 2023-11-18 11:21:10. (29): Completed job in 13.399109125137329 seconds with state DONE.
2023/11/18 11:21:10 Job[go-testjdbcio_postgresreadwrite-481-c125e92e-f395-4d82-bccd-92aba5d71dc0] state: DONE
2023/11/18 11:21:10 🐳 Terminating container: 27aa862f9828
2023/11/18 11:21:10 🚫 Container terminated: 27aa862f9828
--- PASS: TestJDBCIO_PostgresReadWrite (38.52s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 120.786s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33497
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpr8uyu_tv/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40899
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 43s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/g6bqhj3kftidi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_Direct - Build # 4834 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_Direct - Build # 4834 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4834/ to view the results.
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4833
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4833/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
key: "lXsZBOEXdXIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "lXsZBOEXdXTimestampedValueCoder"
>
>
coders: <
key: "lXsZBOEXdXKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "lXsZBOEXdXVarIntCoder"
component_coder_ids: "lXsZBOEXdXRowCoder"
>
>
coders: <
key: "lXsZBOEXdXKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "lXsZBOEXdXVarIntCoder"
component_coder_ids: "lXsZBOEXdXTimestampedValueCoder"
>
>
coders: <
key: "lXsZBOEXdXKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "lXsZBOEXdXVarIntCoder"
component_coder_ids: "lXsZBOEXdXIterableCoder"
>
>
coders: <
key: "lXsZBOEXdXRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$012f4634-9350-44b1-b3e4-8bd094fad49b"
>
>
>
coders: <
key: "lXsZBOEXdXTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\247\232u,sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\241j\017\340\234z\220c\274\377\027\321\357\024NK\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "lXsZBOEXdXVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "lXsZBOEXdXVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "lXsZBOEXdXbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar\022@16f4d405e0bafbaaca81d9b18102cf6f71956da1794415e845b77b2c31e923ac"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-FvTUBeC6-6rKgdmxgQLPb3GVbaF5RBXoRbd7LDHpI6w.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/17 23:21:01 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700263261390271511
2023/11/17 23:21:04 Prepared job with id: go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3 and staging token: go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3
2023/11/17 23:21:04 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3
2023/11/17 23:21:04 Submitted job: go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3
2023/11/17 23:21:04 Job[go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3] state: STOPPED
2023/11/17 23:21:04 Job[go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3] state: STARTING
2023/11/17 23:21:04 Job[go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3] state: RUNNING
2023/11/17 23:21:04 2023-11-17 23:21:04. (1): ==================== <function annotate_downstream_side_inputs at 0x7f0a6235ce50> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f0a6235cf70> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (3): ==================== <function pack_combiners at 0x7f0a6235d4c0> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (4): ==================== <function lift_combiners at 0x7f0a6235d550> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (5): ==================== <function expand_sdf at 0x7f0a6235d700> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (6): ==================== <function expand_gbk at 0x7f0a6235d790> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (7): ==================== <function sink_flattens at 0x7f0a6235d8b0> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (8): ==================== <function greedily_fuse at 0x7f0a6235d940> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (9): ==================== <function read_to_impulse at 0x7f0a6235d9d0> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (10): ==================== <function impulse_to_input at 0x7f0a6235da60> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (11): ==================== <function sort_stages at 0x7f0a6235dca0> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f0a6235ddc0> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (13): ==================== <function setup_timer_mapping at 0x7f0a6235dc10> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (14): ==================== <function populate_data_channel_coders at 0x7f0a6235dd30> ====================
2023/11/17 23:21:04 2023-11-17 23:21:04. (15): starting control server on port 44683
2023/11/17 23:21:04 2023-11-17 23:21:04. (16): starting data server on port 46615
2023/11/17 23:21:04 2023-11-17 23:21:04. (17): starting state server on port 38767
2023/11/17 23:21:04 2023-11-17 23:21:04. (18): starting logging server on port 35299
2023/11/17 23:21:04 2023-11-17 23:21:04. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0a9655dc40> for environment lXsZBOEXdXbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/17 23:21:04 2023-11-17 23:21:04. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/17 23:21:04 2023-11-17 23:21:04. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/17 23:21:10 2023-11-17 23:21:10. (22): Waiting for docker to start up. Current status is running
2023/11/17 23:21:10 2023-11-17 23:21:10. (23): Docker container is running. container_id = b'022edb7f7d9d60da7e8e970f1fbf22906f7186057cdb70f4fc11213d3c265ee4', worker_id = worker_16
2023/11/17 23:21:11 2023-11-17 23:21:11. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0a964a2940> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/17 23:21:14 2023-11-17 23:21:14. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/17 23:21:15 2023-11-17 23:21:15. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/17 23:21:16 2023-11-17 23:21:16. (27): Waiting for docker to start up. Current status is running
2023/11/17 23:21:16 2023-11-17 23:21:16. (28): Docker container is running. container_id = b'a98f47ad6ec61d758144d4ccb6f486d2e2c1c1890519226845a4fe9b72ec28a5', worker_id = worker_18
2023/11/17 23:21:21 2023-11-17 23:21:21. (29): Completed job in 17.193697214126587 seconds with state DONE.
2023/11/17 23:21:21 Job[go-testjdbcio_postgresreadwrite-180-24356e9c-1e4a-4cab-a630-52d745f54da3] state: DONE
2023/11/17 23:21:21 🐳 Terminating container: 4a2e6e1681b5
2023/11/17 23:21:21 🚫 Container terminated: 4a2e6e1681b5
--- PASS: TestJDBCIO_PostgresReadWrite (50.04s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 118.275s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39795
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp0czfxri_/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38259
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 36s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/o3o6hemd5f4dm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4832
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4832/display/redirect?page=changes>
Changes:
[noreply] Document compact lifecycle method (#29466)
------------------------------------------
[...truncated 1.49 MB...]
component_coder_ids: "RnVwYSPzPCTimestampedValueCoder"
>
>
coders: <
key: "RnVwYSPzPCKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "RnVwYSPzPCVarIntCoder"
component_coder_ids: "RnVwYSPzPCIterableCoder"
>
>
coders: <
key: "RnVwYSPzPCRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$3c2d893d-dfa5-4a34-bf3e-b1824eddb91d"
>
>
>
coders: <
key: "RnVwYSPzPCTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000Q\253`#sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\206Z\255\340.t\343\253+\035\013\227\026VA\237\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "RnVwYSPzPCVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "RnVwYSPzPCVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "RnVwYSPzPCbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-aYEogviDHDz4Y57MVvKPDz7snvnucNWtMT43QepbhG4.jar\022@69812882f8831c3cf8639ecc56f28f0f3eec9ef9ee70d5ad313e3741ea5b846e"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-aYEogviDHDz4Y57MVvKPDz7snvnucNWtMT43QepbhG4.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/17 17:20:58 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700241658600133372
2023/11/17 17:21:01 Prepared job with id: go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34 and staging token: go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34
2023/11/17 17:21:01 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34
2023/11/17 17:21:01 Submitted job: go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34
2023/11/17 17:21:01 2023-11-17 17:21:01. (1): ==================== <function annotate_downstream_side_inputs at 0x7f3bbb83be50> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f3bbb83bf70> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (3): ==================== <function pack_combiners at 0x7f3bbb83c4c0> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (4): ==================== <function lift_combiners at 0x7f3bbb83c550> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (5): ==================== <function expand_sdf at 0x7f3bbb83c700> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (6): ==================== <function expand_gbk at 0x7f3bbb83c790> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (7): ==================== <function sink_flattens at 0x7f3bbb83c8b0> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (8): ==================== <function greedily_fuse at 0x7f3bbb83c940> ====================
2023/11/17 17:21:01 Job[go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34] state: STOPPED
2023/11/17 17:21:01 Job[go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34] state: STARTING
2023/11/17 17:21:01 Job[go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34] state: RUNNING
2023/11/17 17:21:01 2023-11-17 17:21:01. (9): ==================== <function read_to_impulse at 0x7f3bbb83c9d0> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (10): ==================== <function impulse_to_input at 0x7f3bbb83ca60> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (11): ==================== <function sort_stages at 0x7f3bbb83cca0> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f3bbb83cdc0> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (13): ==================== <function setup_timer_mapping at 0x7f3bbb83cc10> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (14): ==================== <function populate_data_channel_coders at 0x7f3bbb83cd30> ====================
2023/11/17 17:21:01 2023-11-17 17:21:01. (15): starting control server on port 42443
2023/11/17 17:21:01 2023-11-17 17:21:01. (16): starting data server on port 43683
2023/11/17 17:21:01 2023-11-17 17:21:01. (17): starting state server on port 33627
2023/11/17 17:21:01 2023-11-17 17:21:01. (18): starting logging server on port 46017
2023/11/17 17:21:01 2023-11-17 17:21:01. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3beef2ee50> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/17 17:21:06 2023-11-17 17:21:06. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/17 17:21:06 2023-11-17 17:21:06. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/17 17:21:07 2023-11-17 17:21:07. (22): Waiting for docker to start up. Current status is running
2023/11/17 17:21:07 2023-11-17 17:21:07. (23): Docker container is running. container_id = b'f64158e89baef738a23834cd03540a87f0eb837450971a7438d34772ad815d77', worker_id = worker_17
2023/11/17 17:21:08 2023-11-17 17:21:08. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3beefbd040> for environment RnVwYSPzPCbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/17 17:21:12 2023-11-17 17:21:12. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/17 17:21:13 2023-11-17 17:21:13. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/17 17:21:14 2023-11-17 17:21:14. (27): Waiting for docker to start up. Current status is running
2023/11/17 17:21:14 2023-11-17 17:21:14. (28): Docker container is running. container_id = b'a0d68ef6aacba862d4a49b4cb0707b6ba34428d27d978e5d69a3b873aa6a0f6e', worker_id = worker_19
2023/11/17 17:21:21 2023-11-17 17:21:21. (29): Completed job in 19.69351053237915 seconds with state DONE.
2023/11/17 17:21:21 Job[go-testjdbcio_postgresreadwrite-608-316041ed-f13f-43bf-a612-6a2835f5bb34] state: DONE
2023/11/17 17:21:21 🐳 Terminating container: 75ca664e57c2
2023/11/17 17:21:21 🚫 Container terminated: 75ca664e57c2
--- PASS: TestJDBCIO_PostgresReadWrite (49.30s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 129.616s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 41421
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp5qgsh0r1/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 37755
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 28s
258 actionable tasks: 175 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cygl77ckchwdy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4831
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4831/display/redirect>
Changes:
------------------------------------------
[...truncated 1.37 MB...]
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "WJZUObeqfQVarIntCoder"
component_coder_ids: "WJZUObeqfQTimestampedValueCoder"
>
>
coders: <
key: "WJZUObeqfQKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "WJZUObeqfQVarIntCoder"
component_coder_ids: "WJZUObeqfQIterableCoder"
>
>
coders: <
key: "WJZUObeqfQRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$5559ea91-8bb6-42a1-ad12-b8a5a1b124fb"
>
>
>
coders: <
key: "WJZUObeqfQTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000Q\253`#sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\2742\225\332L[\263\365\274\017#\341\366aOw\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "WJZUObeqfQVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "WJZUObeqfQVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "WJZUObeqfQbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar\022@f80d6479fb82cd3b8a6b3af5fa9887e986d6dfaf587e8783bcec9e53c00f1958"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/17 11:21:59 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700220119529135221
2023/11/17 11:22:02 Prepared job with id: go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59 and staging token: go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59
2023/11/17 11:22:02 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59
2023/11/17 11:22:02 Submitted job: go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59
2023/11/17 11:22:02 2023-11-17 11:22:02. (5): ==================== <function expand_sdf at 0x7f4f768eb700> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (6): ==================== <function expand_gbk at 0x7f4f768eb790> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (7): ==================== <function sink_flattens at 0x7f4f768eb8b0> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (8): ==================== <function greedily_fuse at 0x7f4f768eb940> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (9): ==================== <function read_to_impulse at 0x7f4f768eb9d0> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (10): ==================== <function impulse_to_input at 0x7f4f768eba60> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (11): ==================== <function sort_stages at 0x7f4f768ebca0> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f4f768ebdc0> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (13): ==================== <function setup_timer_mapping at 0x7f4f768ebc10> ====================
2023/11/17 11:22:02 2023-11-17 11:22:02. (14): ==================== <function populate_data_channel_coders at 0x7f4f768ebd30> ====================
2023/11/17 11:22:02 Job[go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59] state: STOPPED
2023/11/17 11:22:02 Job[go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59] state: STARTING
2023/11/17 11:22:02 Job[go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59] state: RUNNING
2023/11/17 11:22:02 2023-11-17 11:22:02. (15): starting control server on port 39969
2023/11/17 11:22:02 2023-11-17 11:22:02. (16): starting data server on port 40323
2023/11/17 11:22:02 2023-11-17 11:22:02. (17): starting state server on port 36635
2023/11/17 11:22:02 2023-11-17 11:22:02. (18): starting logging server on port 46603
2023/11/17 11:22:02 2023-11-17 11:22:02. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4fab2d9df0> for environment WJZUObeqfQbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/17 11:22:06 2023-11-17 11:22:06. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/17 11:22:07 2023-11-17 11:22:07. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/17 11:22:08 2023-11-17 11:22:08. (22): Waiting for docker to start up. Current status is running
2023/11/17 11:22:08 2023-11-17 11:22:08. (23): Docker container is running. container_id = b'92db35513e7c1a2bb8ece56877cb916eaeb609471a2a95265658c961ee8f5fa9', worker_id = worker_17
2023/11/17 11:22:09 2023-11-17 11:22:09. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4fab281850> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/17 11:22:11 2023-11-17 11:22:11. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/17 11:22:12 2023-11-17 11:22:12. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/17 11:22:13 2023-11-17 11:22:13. (27): Waiting for docker to start up. Current status is running
2023/11/17 11:22:13 2023-11-17 11:22:13. (28): Docker container is running. container_id = b'abf0d0ca659e102869b57545592e5a7a4a7ade7f1065584cbb5e35dc2c8b8453', worker_id = worker_19
2023/11/17 11:22:17 2023-11-17 11:22:17. (29): Completed job in 14.458078861236572 seconds with state DONE.
2023/11/17 11:22:17 Job[go-testjdbcio_postgresreadwrite-35-be0a3588-df21-4653-b0d6-aeaf1bdf8b59] state: DONE
2023/11/17 11:22:17 🐳 Terminating container: d89c85066ac7
2023/11/17 11:22:17 🚫 Container terminated: d89c85066ac7
--- PASS: TestJDBCIO_PostgresReadWrite (46.38s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 130.420s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 43341
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp3rf7jlqo/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 44599
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 29s
258 actionable tasks: 172 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ig7r4iopl6fhy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4830
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4830/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
component_coder_ids: "WnRERXVDcdTimestampedValueCoder"
>
>
coders: <
key: "WnRERXVDcdKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "WnRERXVDcdVarIntCoder"
component_coder_ids: "WnRERXVDcdIterableCoder"
>
>
coders: <
key: "WnRERXVDcdRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$4e4ffce4-f60f-4243-b9e0-340c2659b226"
>
>
>
coders: <
key: "WnRERXVDcdTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\0009\251\n\343sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\231\250\264\251\274\222\353\rn+?\030\221\231N\210\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "WnRERXVDcdVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "WnRERXVDcdVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "WnRERXVDcdbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar\022@f80d6479fb82cd3b8a6b3af5fa9887e986d6dfaf587e8783bcec9e53c00f1958"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/17 05:21:10 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700198470795759288
2023/11/17 05:21:13 Prepared job with id: go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b and staging token: go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b
2023/11/17 05:21:13 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b
2023/11/17 05:21:13 Submitted job: go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b
2023/11/17 05:21:13 Job[go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b] state: STOPPED
2023/11/17 05:21:13 Job[go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b] state: STARTING
2023/11/17 05:21:13 Job[go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b] state: RUNNING
2023/11/17 05:21:13 2023-11-17 05:21:13. (1): ==================== <function annotate_downstream_side_inputs at 0x7fcaad935e50> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fcaad935f70> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (3): ==================== <function pack_combiners at 0x7fcaad9364c0> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (4): ==================== <function lift_combiners at 0x7fcaad936550> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (5): ==================== <function expand_sdf at 0x7fcaad936700> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (6): ==================== <function expand_gbk at 0x7fcaad936790> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (7): ==================== <function sink_flattens at 0x7fcaad9368b0> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (8): ==================== <function greedily_fuse at 0x7fcaad936940> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (9): ==================== <function read_to_impulse at 0x7fcaad9369d0> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (10): ==================== <function impulse_to_input at 0x7fcaad936a60> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (11): ==================== <function sort_stages at 0x7fcaad936ca0> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fcaad936dc0> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (13): ==================== <function setup_timer_mapping at 0x7fcaad936c10> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (14): ==================== <function populate_data_channel_coders at 0x7fcaad936d30> ====================
2023/11/17 05:21:13 2023-11-17 05:21:13. (15): starting control server on port 33389
2023/11/17 05:21:13 2023-11-17 05:21:13. (16): starting data server on port 38485
2023/11/17 05:21:13 2023-11-17 05:21:13. (17): starting state server on port 37261
2023/11/17 05:21:13 2023-11-17 05:21:13. (18): starting logging server on port 45833
2023/11/17 05:21:13 2023-11-17 05:21:13. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcae23343d0> for environment WnRERXVDcdbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/17 05:21:17 2023-11-17 05:21:17. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/17 05:21:17 2023-11-17 05:21:17. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/17 05:21:18 2023-11-17 05:21:18. (22): Waiting for docker to start up. Current status is running
2023/11/17 05:21:18 2023-11-17 05:21:18. (23): Docker container is running. container_id = b'048194ed314739af2feb4b190d75dd6a88e086e36ead748d36304f6cdae7fd89', worker_id = worker_17
2023/11/17 05:21:19 2023-11-17 05:21:19. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcae22d3d30> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/17 05:21:22 2023-11-17 05:21:22. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/17 05:21:22 2023-11-17 05:21:22. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/17 05:21:24 2023-11-17 05:21:24. (27): Waiting for docker to start up. Current status is running
2023/11/17 05:21:24 2023-11-17 05:21:24. (28): Docker container is running. container_id = b'dd5af48093c4a358688c021ab15da776adb98bbb2201641a47010421e9a2235e', worker_id = worker_19
2023/11/17 05:21:27 2023-11-17 05:21:27. (29): Completed job in 14.250267505645752 seconds with state DONE.
2023/11/17 05:21:27 Job[go-testjdbcio_postgresreadwrite-907-17f81fc8-3562-454b-867c-36121ccf794b] state: DONE
2023/11/17 05:21:27 🐳 Terminating container: d2601fd1b308
2023/11/17 05:21:28 🚫 Container terminated: d2601fd1b308
--- PASS: TestJDBCIO_PostgresReadWrite (43.86s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 126.197s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.044s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 44065
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpe0f44vl5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 38491
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 54s
258 actionable tasks: 175 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/th3ps5cvjh37s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4829
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4829/display/redirect>
Changes:
------------------------------------------
[...truncated 1.61 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:03 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:03 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:03 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:05 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:05 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:05 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f929892baf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f929892bb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f929892c310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f6537479e50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f6537479f70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f653747a4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f653747a550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f653747a700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f653747a790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f653747a8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f653747a940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f653747a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f653747aa60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f653747aca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f653747adc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f653747ac10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f653747ad30> ====================
INFO root:portable_runner.py:543 starting control server on port 40803
INFO root:portable_runner.py:543 starting data server on port 46485
INFO root:portable_runner.py:543 starting state server on port 43203
INFO root:portable_runner.py:543 starting logging server on port 38697
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f65662aa400> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'5820c15b2edf0b44c3521d8a90a29fcc82e7714fea6bfeefa48083b213a51bac', worker_id = worker_83
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f65662ae2b0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7934a096191878133682a02bfcb7d48a7e4dfa787c8614cffea92fb7648bc5db', worker_id = worker_84
INFO root:portable_runner.py:543 Completed job in 15.237096786499023 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57485' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:57485
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:30 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:30 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:31 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:31 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:33 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:38:34 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f929892baf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f929892bb80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f929892c310> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f6537479e50> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f6537479f70> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f653747a4c0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f653747a550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f653747a700> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f653747a790> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f653747a8b0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f653747a940> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f653747a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f653747aa60> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f653747aca0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f653747adc0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f653747ac10> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f653747ad30> ====================
INFO root:portable_runner.py:543 starting control server on port 41453
INFO root:portable_runner.py:543 starting data server on port 46079
INFO root:portable_runner.py:543 starting state server on port 46861
INFO root:portable_runner.py:543 starting logging server on port 40539
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f65662f5130> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'5ab6474644b11613c183574c76bea1b0d57a453f93c0315a7cc384895e120bd2', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f65662ee430> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'91cad7d79e461c57c1c82da017ed1888f61a25e90fc88c1be2381428aea1253e', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 17.332332611083984 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 264.81s (0:04:24) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2186408
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2187125.
Stopping expansion service pid: 2187126.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 36s
258 actionable tasks: 172 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/f7hjjmx62kdl4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4828
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4828/display/redirect>
Changes:
------------------------------------------
[...truncated 1.50 MB...]
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$1b87e81f-db49-496e-a4e0-3990a207e886"
>
>
>
coders: <
key: "OybutYjEjLTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\0009\251\n\343sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\263\244r\017\370l`\256\347\360\3429M\225A\274\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "OybutYjEjLVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "OybutYjEjLVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "OybutYjEjLbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar\022@f80d6479fb82cd3b8a6b3af5fa9887e986d6dfaf587e8783bcec9e53c00f1958"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/16 17:21:23 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700155283800779149
2023/11/16 17:21:26 Prepared job with id: go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1 and staging token: go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1
2023/11/16 17:21:26 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1
2023/11/16 17:21:26 Submitted job: go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1
2023/11/16 17:21:26 2023-11-16 17:21:26. (1): ==================== <function annotate_downstream_side_inputs at 0x7fc3de6b2e50> ====================
2023/11/16 17:21:26 Job[go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1] state: STOPPED
2023/11/16 17:21:26 Job[go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1] state: STARTING
2023/11/16 17:21:26 Job[go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1] state: RUNNING
2023/11/16 17:21:26 2023-11-16 17:21:26. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fc3de6b2f70> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (3): ==================== <function pack_combiners at 0x7fc3de6b34c0> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (4): ==================== <function lift_combiners at 0x7fc3de6b3550> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (5): ==================== <function expand_sdf at 0x7fc3de6b3700> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (6): ==================== <function expand_gbk at 0x7fc3de6b3790> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (7): ==================== <function sink_flattens at 0x7fc3de6b38b0> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (8): ==================== <function greedily_fuse at 0x7fc3de6b3940> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (9): ==================== <function read_to_impulse at 0x7fc3de6b39d0> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (10): ==================== <function impulse_to_input at 0x7fc3de6b3a60> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (11): ==================== <function sort_stages at 0x7fc3de6b3ca0> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fc3de6b3dc0> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (13): ==================== <function setup_timer_mapping at 0x7fc3de6b3c10> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (14): ==================== <function populate_data_channel_coders at 0x7fc3de6b3d30> ====================
2023/11/16 17:21:26 2023-11-16 17:21:26. (15): starting control server on port 34725
2023/11/16 17:21:26 2023-11-16 17:21:26. (16): starting data server on port 36479
2023/11/16 17:21:26 2023-11-16 17:21:26. (17): starting state server on port 44077
2023/11/16 17:21:26 2023-11-16 17:21:26. (18): starting logging server on port 43925
2023/11/16 17:21:26 2023-11-16 17:21:26. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc412043850> for environment OybutYjEjLbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/16 17:21:31 2023-11-16 17:21:31. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/16 17:21:31 2023-11-16 17:21:31. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/16 17:21:33 2023-11-16 17:21:33. (22): Waiting for docker to start up. Current status is running
2023/11/16 17:21:33 2023-11-16 17:21:33. (23): Docker container is running. container_id = b'98b5d55037ae1efea0b5497a8c8d488bd8d904e8336cc90be46b12602941684c', worker_id = worker_18
2023/11/16 17:21:34 2023-11-16 17:21:34. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc412055fd0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/16 17:21:34 2023-11-16 17:21:34. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/16 17:21:34 2023-11-16 17:21:34. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/16 17:21:35 2023-11-16 17:21:35. (27): Waiting for docker to start up. Current status is running
2023/11/16 17:21:35 2023-11-16 17:21:35. (28): Docker container is running. container_id = b'44046d12c10c82e3dc74c5a42eb940d0251b1610b20863dbe0e1b785b65f275e', worker_id = worker_19
2023/11/16 17:21:39 2023-11-16 17:21:39. (29): Completed job in 12.274114608764648 seconds with state DONE.
2023/11/16 17:21:39 Job[go-testjdbcio_postgresreadwrite-362-8073d6de-c22b-45e9-9dda-e7b04cf93fb1] state: DONE
2023/11/16 17:21:39 🐳 Terminating container: 3c064b944b6b
2023/11/16 17:21:39 🚫 Container terminated: 3c064b944b6b
--- PASS: TestJDBCIO_PostgresReadWrite (38.98s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 123.190s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.027s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 41283
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpg4xk9lu5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 37257
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 33m 6s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/t3s2fjg3hdmby
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4827
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4827/display/redirect>
Changes:
------------------------------------------
[...truncated 1.57 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:36:50 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:36:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:36:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:36:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:36:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:36:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb097fc6160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb097fc61f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb097fc6940> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f5b0fb4c430> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5b0fb4c550> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5b0fb4ca60> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5b0fb4caf0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5b0fb4cca0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5b0fb4cd30> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5b0fb4ce50> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5b0fb4cee0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5b0fb4cf70> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5b0fb4d040> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5b0fb4d280> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5b0fb4d3a0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5b0fb4d1f0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f5b0fb4d310> ====================
INFO root:portable_runner.py:543 starting control server on port 45097
INFO root:portable_runner.py:543 starting data server on port 40893
INFO root:portable_runner.py:543 starting state server on port 46643
INFO root:portable_runner.py:543 starting logging server on port 40605
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5b435ff8b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'6c175f16ede8197d2431f3f12c9905989bec25a6395514b10c4ad80b120334cd', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5b43c96760> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ce46c351baf8b30318ac31130327a11f876c9cb2315248df5f4bb1effda9a691', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.501418590545654 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '33749' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:33749
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:37:18 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:37:19 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:37:19 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:37:19 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:37:21 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 16, 2023 11:37:23 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb097fc6160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb097fc61f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb097fc6940> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f5b0fb4c430> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5b0fb4c550> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5b0fb4ca60> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5b0fb4caf0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5b0fb4cca0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5b0fb4cd30> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5b0fb4ce50> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5b0fb4cee0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5b0fb4cf70> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5b0fb4d040> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5b0fb4d280> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5b0fb4d3a0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5b0fb4d1f0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f5b0fb4d310> ====================
INFO root:portable_runner.py:543 starting control server on port 35727
INFO root:portable_runner.py:543 starting data server on port 36597
INFO root:portable_runner.py:543 starting state server on port 46543
INFO root:portable_runner.py:543 starting logging server on port 45991
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5b43543c70> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'60b118425a7098db28603a238301debd7ebd9f1f6210a9a1dd1703fd911e825c', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5b4355a430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'62c24f9ccc8755ddc919ad336ae667db9aaefb7c93e6ce15ac44bb4d17c21563', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.248894214630127 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7231 deselected in 274.37s (0:04:34) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1266534
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1267042.
Stopping expansion service pid: 1267043.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 23s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/qkr3vszpgtueg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4826
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4826/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
component_coder_ids: "LoIGURSMxpTimestampedValueCoder"
>
>
coders: <
key: "LoIGURSMxpKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "LoIGURSMxpVarIntCoder"
component_coder_ids: "LoIGURSMxpIterableCoder"
>
>
coders: <
key: "LoIGURSMxpRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$a6a60572-c625-4a43-b998-2724de639cf0"
>
>
>
coders: <
key: "LoIGURSMxpTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\0009\251\n\343sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\211\237\322\007\221&s\203\037\343\201L\303\370K\037\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "LoIGURSMxpVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "LoIGURSMxpVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "LoIGURSMxpbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar\022@f80d6479fb82cd3b8a6b3af5fa9887e986d6dfaf587e8783bcec9e53c00f1958"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT--A1kefuCzTuKazr1-piH6YbW369YfoeDvOyeU8APGVg.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/16 05:21:31 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700112091868809129
2023/11/16 05:21:34 Prepared job with id: go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02 and staging token: go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02
2023/11/16 05:21:34 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02
2023/11/16 05:21:34 Submitted job: go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02
2023/11/16 05:21:34 2023-11-16 05:21:34. (1): ==================== <function annotate_downstream_side_inputs at 0x7fa451c78430> ====================
2023/11/16 05:21:34 Job[go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02] state: STOPPED
2023/11/16 05:21:34 Job[go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02] state: STARTING
2023/11/16 05:21:34 Job[go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02] state: RUNNING
2023/11/16 05:21:34 2023-11-16 05:21:34. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fa451c78550> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (3): ==================== <function pack_combiners at 0x7fa451c78a60> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (4): ==================== <function lift_combiners at 0x7fa451c78af0> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (5): ==================== <function expand_sdf at 0x7fa451c78ca0> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (6): ==================== <function expand_gbk at 0x7fa451c78d30> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (7): ==================== <function sink_flattens at 0x7fa451c78e50> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (8): ==================== <function greedily_fuse at 0x7fa451c78ee0> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (9): ==================== <function read_to_impulse at 0x7fa451c78f70> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (10): ==================== <function impulse_to_input at 0x7fa451c7e040> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (11): ==================== <function sort_stages at 0x7fa451c7e280> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fa451c7e3a0> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (13): ==================== <function setup_timer_mapping at 0x7fa451c7e1f0> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (14): ==================== <function populate_data_channel_coders at 0x7fa451c7e310> ====================
2023/11/16 05:21:34 2023-11-16 05:21:34. (15): starting control server on port 35783
2023/11/16 05:21:34 2023-11-16 05:21:34. (16): starting data server on port 36603
2023/11/16 05:21:34 2023-11-16 05:21:34. (17): starting state server on port 35047
2023/11/16 05:21:34 2023-11-16 05:21:34. (18): starting logging server on port 40465
2023/11/16 05:21:34 2023-11-16 05:21:34. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa484ff2610> for environment LoIGURSMxpbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/16 05:21:34 2023-11-16 05:21:34. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/16 05:21:35 2023-11-16 05:21:35. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/16 05:21:40 2023-11-16 05:21:40. (22): Waiting for docker to start up. Current status is running
2023/11/16 05:21:40 2023-11-16 05:21:40. (23): Docker container is running. container_id = b'bfece2f8f03087e9d13998a967f378a2a95be7abfc71526f2575f2963843434d', worker_id = worker_16
2023/11/16 05:21:41 2023-11-16 05:21:41. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa485e41be0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/16 05:21:44 2023-11-16 05:21:44. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/16 05:21:44 2023-11-16 05:21:44. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/16 05:21:45 2023-11-16 05:21:45. (27): Waiting for docker to start up. Current status is running
2023/11/16 05:21:45 2023-11-16 05:21:45. (28): Docker container is running. container_id = b'73e71618be66760cf44da380b75af18e8c5c44bad4f82505fc807a75ffc4e6e3', worker_id = worker_18
2023/11/16 05:21:50 2023-11-16 05:21:50. (29): Completed job in 16.037511348724365 seconds with state DONE.
2023/11/16 05:21:50 Job[go-testjdbcio_postgresreadwrite-474-b0bb471d-9ef3-4f05-8c93-a4e8911d1a02] state: DONE
2023/11/16 05:21:50 🐳 Terminating container: 16318047d6e0
2023/11/16 05:21:51 🚫 Container terminated: 16318047d6e0
--- PASS: TestJDBCIO_PostgresReadWrite (45.45s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 127.659s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 35679
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpibunn72x/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 39177
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 39s
258 actionable tasks: 175 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/lh3hytob4hu5y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4825
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4825/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:40:42 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:40:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:40:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:40:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:40:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:40:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff2f5b06dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff2f5b06e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff2f5b085e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f338b1f0310> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f338b1f0430> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f338b1f0940> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f338b1f09d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f338b1f0b80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f338b1f0c10> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f338b1f0d30> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f338b1f0dc0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f338b1f0e50> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f338b1f0ee0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f338b1f1160> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f338b1f1280> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f338b1f10d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f338b1f11f0> ====================
INFO root:portable_runner.py:543 starting control server on port 42403
INFO root:portable_runner.py:543 starting data server on port 35179
INFO root:portable_runner.py:543 starting state server on port 33159
INFO root:portable_runner.py:543 starting logging server on port 37031
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33ba3e66d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'02bc3bf853340fa1d3b0f4fc7cb52e5ab2bcdb50b7e25ee420126c657ca826d7', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33bcae9eb0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f6394e4d01e2824534ec2166a2cbb2d3042d2be02a8a062cda57628bda3e61a9', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 16.860698699951172 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '56289' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:56289
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:41:10 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:41:11 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:41:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:41:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:41:13 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:41:15 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff2f5b06dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff2f5b06e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff2f5b085e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f338b1f0310> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f338b1f0430> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f338b1f0940> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f338b1f09d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f338b1f0b80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f338b1f0c10> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f338b1f0d30> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f338b1f0dc0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f338b1f0e50> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f338b1f0ee0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f338b1f1160> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f338b1f1280> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f338b1f10d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f338b1f11f0> ====================
INFO root:portable_runner.py:543 starting control server on port 42067
INFO root:portable_runner.py:543 starting data server on port 46397
INFO root:portable_runner.py:543 starting state server on port 38489
INFO root:portable_runner.py:543 starting logging server on port 37731
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33bcb3e520> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'012889d91258a0634d6b29d4a2f6b693e02ebe0e550ed7239933f05bc840139b', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33bca61f10> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cc8879d39e79225abe600f09d33fec479e0c60acf59fd7e273abf563a6f7a842', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.386155366897583 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7231 deselected in 259.73s (0:04:19) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3077998
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3078667.
Stopping expansion service pid: 3078668.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 31m 14s
258 actionable tasks: 175 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/dxfmznjpqmsrw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4824
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4824/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
>
>
>
coders: <
key: "kwBiGIQkhSIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "kwBiGIQkhSTimestampedValueCoder"
>
>
coders: <
key: "kwBiGIQkhSKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "kwBiGIQkhSVarIntCoder"
component_coder_ids: "kwBiGIQkhSRowCoder"
>
>
coders: <
key: "kwBiGIQkhSKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "kwBiGIQkhSVarIntCoder"
component_coder_ids: "kwBiGIQkhSTimestampedValueCoder"
>
>
coders: <
key: "kwBiGIQkhSKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "kwBiGIQkhSVarIntCoder"
component_coder_ids: "kwBiGIQkhSIterableCoder"
>
>
coders: <
key: "kwBiGIQkhSRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$3930224c-481b-4f6c-a174-01d7d57d69b8"
>
>
>
coders: <
key: "kwBiGIQkhSTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\037\326\256\007sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\210\367\237\216'p\225\037\221q\327\017L\263E\025\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "kwBiGIQkhSVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "kwBiGIQkhSVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "kwBiGIQkhSbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-0bGnDG1G1GisjkxW1wrADaBrEtR79GjtUazZ2mZmoY4.jar\022@d1b1a70c6d46d468ac8e4c56d70ac00da06b12d47bf468ed51acd9da6666a18e"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-0bGnDG1G1GisjkxW1wrADaBrEtR79GjtUazZ2mZmoY4.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/15 17:21:36 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700068896587338730
2023/11/15 17:21:39 Prepared job with id: go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78 and staging token: go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78
2023/11/15 17:21:39 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78
2023/11/15 17:21:39 Submitted job: go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78
2023/11/15 17:21:39 2023-11-15 17:21:39. (5): ==================== <function expand_sdf at 0x7fdef17bdb80> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (6): ==================== <function expand_gbk at 0x7fdef17bdc10> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (7): ==================== <function sink_flattens at 0x7fdef17bdd30> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (8): ==================== <function greedily_fuse at 0x7fdef17bddc0> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (9): ==================== <function read_to_impulse at 0x7fdef17bde50> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (10): ==================== <function impulse_to_input at 0x7fdef17bdee0> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (11): ==================== <function sort_stages at 0x7fdef17be160> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fdef17be280> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (13): ==================== <function setup_timer_mapping at 0x7fdef17be0d0> ====================
2023/11/15 17:21:39 2023-11-15 17:21:39. (14): ==================== <function populate_data_channel_coders at 0x7fdef17be1f0> ====================
2023/11/15 17:21:39 Job[go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78] state: STOPPED
2023/11/15 17:21:39 Job[go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78] state: STARTING
2023/11/15 17:21:39 Job[go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78] state: RUNNING
2023/11/15 17:21:39 2023-11-15 17:21:39. (15): starting control server on port 33341
2023/11/15 17:21:39 2023-11-15 17:21:39. (16): starting data server on port 37781
2023/11/15 17:21:39 2023-11-15 17:21:39. (17): starting state server on port 44847
2023/11/15 17:21:39 2023-11-15 17:21:39. (18): starting logging server on port 43879
2023/11/15 17:21:39 2023-11-15 17:21:39. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf2616f1c0> for environment kwBiGIQkhSbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/15 17:21:43 2023-11-15 17:21:43. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/15 17:21:43 2023-11-15 17:21:43. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/15 17:21:44 2023-11-15 17:21:44. (22): Waiting for docker to start up. Current status is running
2023/11/15 17:21:44 2023-11-15 17:21:44. (23): Docker container is running. container_id = b'7f3d66419cb84467c0d99277d9cadcd2fa763a1fdc8d327466db817d1eb757b3', worker_id = worker_17
2023/11/15 17:21:45 2023-11-15 17:21:45. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf261161c0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/15 17:21:48 2023-11-15 17:21:48. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/15 17:21:48 2023-11-15 17:21:48. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/15 17:21:50 2023-11-15 17:21:50. (27): Waiting for docker to start up. Current status is running
2023/11/15 17:21:50 2023-11-15 17:21:50. (28): Docker container is running. container_id = b'1aa6e9eb40c46e604492e04b80da977a80a50489514fd1dadaf7a28deb8d11c3', worker_id = worker_19
2023/11/15 17:21:53 2023-11-15 17:21:53. (29): Completed job in 14.231083631515503 seconds with state DONE.
2023/11/15 17:21:53 Job[go-testjdbcio_postgresreadwrite-769-a09186b7-1435-4a4c-9f27-72334c294b78] state: DONE
2023/11/15 17:21:53 🐳 Terminating container: e91087485889
2023/11/15 17:21:53 🚫 Container terminated: e91087485889
--- PASS: TestJDBCIO_PostgresReadWrite (43.56s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 142.688s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.030s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 35065
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpd6ku8hyp/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 37849
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 50s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/lz4ibcuycgduk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4823
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4823/display/redirect?page=changes>
Changes:
[noreply] Garbage collect side inputs. (#29423)
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:36:48 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:36:48 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:36:48 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:36:50 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:36:50 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:36:50 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0e367c2dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0e367c2e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0e367c45e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff5289fe310> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff5289fe430> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff5289fe940> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff5289fe9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff5289feb80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff5289fec10> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff5289fed30> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff5289fedc0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff5289fee50> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff5289feee0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff528a00160> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff528a00280> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff528a000d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff528a001f0> ====================
INFO root:portable_runner.py:543 starting control server on port 43743
INFO root:portable_runner.py:543 starting data server on port 41935
INFO root:portable_runner.py:543 starting state server on port 44471
INFO root:portable_runner.py:543 starting logging server on port 33559
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff55c1b96a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bcc4f24220f1639b13962555ceb2e856ad390eb9e88b8eee11bfaf13d5d6369c', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff55c650a90> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c7341932657e1035b36722010c4d2df73b1f19b4559d772752160057155c978c', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.201895952224731 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '47799' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:47799
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:37:15 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:37:15 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:37:15 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:37:16 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:37:18 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 11:37:19 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0e367c2dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0e367c2e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0e367c45e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff5289fe310> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff5289fe430> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff5289fe940> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff5289fe9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff5289feb80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff5289fec10> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff5289fed30> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff5289fedc0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff5289fee50> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff5289feee0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff528a00160> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff528a00280> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff528a000d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff528a001f0> ====================
INFO root:portable_runner.py:543 starting control server on port 38027
INFO root:portable_runner.py:543 starting data server on port 45073
INFO root:portable_runner.py:543 starting state server on port 41825
INFO root:portable_runner.py:543 starting logging server on port 34521
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff55c6e6910> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bbb8683554e44ccdb1ee69b40e081b8746ed4714fe568ba5f85a3d0a269e7f82', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff55c6c5f70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f29086f927addd36632c9f945473bf9630ef4cf000304e34f753159cde5c64be', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.165015935897827 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7231 deselected in 258.41s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3753451
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3753971.
Stopping expansion service pid: 3753972.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 21s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wxjhshn3gqqyg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4822
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4822/display/redirect>
Changes:
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff191295dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff191295e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff1912935e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4eae54a310> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4eae54a430> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4eae54a940> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4eae54a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4eae54ab80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4eae54ac10> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4eae54ad30> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4eae54adc0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4eae54ae50> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4eae54aee0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4eae54c160> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4eae54c280> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4eae54c0d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4eae54c1f0> ====================
INFO root:portable_runner.py:543 starting control server on port 33905
INFO root:portable_runner.py:543 starting data server on port 39861
INFO root:portable_runner.py:543 starting state server on port 43539
INFO root:portable_runner.py:543 starting logging server on port 37751
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4edfe78cd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b22d460aa0b828710d394ad0ed7ef280326af656172123871f2abbcde612c691', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4edfe1c670> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c26dde937a112b0de9278d4ed3b4fbf727c917ef48583bead9c24ca4895d5436', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.2626314163208 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '56139' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:56139
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:37:13 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:37:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:37:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:37:15 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 15, 2023 5:37:17 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff191295dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff191295e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff1912935e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4eae54a310> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4eae54a430> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4eae54a940> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4eae54a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4eae54ab80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4eae54ac10> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4eae54ad30> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4eae54adc0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4eae54ae50> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4eae54aee0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4eae54c160> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4eae54c280> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4eae54c0d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4eae54c1f0> ====================
INFO root:portable_runner.py:543 starting control server on port 36639
INFO root:portable_runner.py:543 starting data server on port 33359
INFO root:portable_runner.py:543 starting state server on port 38939
INFO root:portable_runner.py:543 starting logging server on port 36447
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4eac4128e0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd497366d1005e1667715a4f7fc442fc568fe0a452cffdd53caa4d2a4fa603406', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4ee2e2f1c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a5a2e72a7265fa72f9e44de9857aad9e3cc521135a0b1924d9a0eee26a5df5be', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.661372661590576 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7231 deselected in 260.19s (0:04:20) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3289518
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3290412.
Stopping expansion service pid: 3290413.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 20s
258 actionable tasks: 175 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ronuhv3lztfxe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4821
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4821/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:36:39 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:36:39 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:36:39 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:36:41 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:36:41 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:36:41 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff3f445eca0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff3f445ed30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff3f44604c0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc63c9401f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc63c940310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc63c940820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc63c9408b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc63c940a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc63c940af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc63c940c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc63c940ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc63c940d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc63c940dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc63c941040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc63c941160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc63c940f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc63c9410d0> ====================
INFO root:portable_runner.py:543 starting control server on port 41035
INFO root:portable_runner.py:543 starting data server on port 35507
INFO root:portable_runner.py:543 starting state server on port 33171
INFO root:portable_runner.py:543 starting logging server on port 34985
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc6705ffe80> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'41d97a0716e536cd6f44920beb5e8c4ffa069706f4ce45793d19a321ac9b8625', worker_id = worker_83
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc6705fce80> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fb769505e2f9ca976c6d8d4f5ef7cd0114feb3fb16f490dbc38b5dff1dd180db', worker_id = worker_84
INFO root:portable_runner.py:543 Completed job in 15.162849426269531 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '51385' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:51385
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:37:05 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:37:08 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 11:37:10 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff3f445eca0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff3f445ed30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff3f44604c0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc63c9401f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc63c940310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc63c940820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc63c9408b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc63c940a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc63c940af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc63c940c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc63c940ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc63c940d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc63c940dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc63c941040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc63c941160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc63c940f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc63c9410d0> ====================
INFO root:portable_runner.py:543 starting control server on port 37517
INFO root:portable_runner.py:543 starting data server on port 45919
INFO root:portable_runner.py:543 starting state server on port 38963
INFO root:portable_runner.py:543 starting logging server on port 46391
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc6705ddb50> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4c27efe114d370229916a0da00cc50592df4a82f631f65c9219270870b42437d', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc6705c7b20> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'04067aa893e0ee8e63f4b5ad9aec60fecc71bf61626a4b17c4424bf525d76e35', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.374031782150269 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7231 deselected in 261.42s (0:04:21) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1662751
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1663247.
Stopping expansion service pid: 1663248.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 13s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/nwkn3pdupqizs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4820
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4820/display/redirect?page=changes>
Changes:
[noreply] Bump actions/github-script from 6 to 7 (#29427)
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:39:46 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:39:46 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:39:47 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:39:50 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:39:50 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:39:50 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0e40977b80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0e40977c10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0e409793a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd9b41840d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd9b41841f0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd9b4184700> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd9b4184790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd9b4184940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd9b41849d0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd9b4184af0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd9b4184b80> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd9b4184c10> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd9b4184ca0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd9b4184ee0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd9b4186040> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd9b4184e50> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd9b4184f70> ====================
INFO root:portable_runner.py:543 starting control server on port 39459
INFO root:portable_runner.py:543 starting data server on port 40523
INFO root:portable_runner.py:543 starting state server on port 43583
INFO root:portable_runner.py:543 starting logging server on port 45113
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd9e7538d30> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'98f792372654ee496ae3bff2a4ea976377a2dfcb7f79fca46dcce99fc6d428cd', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd9e75e67c0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a131fcfc28683b67e54938797089337b9ba8b026556548817508de62a5b4f1a8', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 27.659454107284546 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '41011' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:41011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:40:30 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:41011.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:40:33 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:40:33 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:40:34 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:40:37 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:40:40 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0e40977b80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0e40977c10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0e409793a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd9b41840d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd9b41841f0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd9b4184700> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd9b4184790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd9b4184940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd9b41849d0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd9b4184af0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd9b4184b80> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd9b4184c10> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd9b4184ca0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd9b4184ee0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd9b4186040> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd9b4184e50> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd9b4184f70> ====================
INFO root:portable_runner.py:543 starting control server on port 34773
INFO root:portable_runner.py:543 starting data server on port 36039
INFO root:portable_runner.py:543 starting state server on port 34705
INFO root:portable_runner.py:543 starting logging server on port 38921
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd9e7532fd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ffc41ecd8ccc19923cffdbee452acb8e9889626668e742c6674e1dd24fe1d9e1', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd9e74d8790> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8ca249b43457474469a61239c4ba7d606e888cf1298c26f2bb180ad5ca7ff10d', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 21.531769275665283 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7231 deselected in 392.82s (0:06:32) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2600521
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2601032.
Stopping expansion service pid: 2601033.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 30m 50s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ckhukfoowtbko
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4819
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4819/display/redirect>
Changes:
------------------------------------------
[...truncated 1.36 MB...]
key: "cENBllJboPIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "cENBllJboPTimestampedValueCoder"
>
>
coders: <
key: "cENBllJboPKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "cENBllJboPVarIntCoder"
component_coder_ids: "cENBllJboPRowCoder"
>
>
coders: <
key: "cENBllJboPKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "cENBllJboPVarIntCoder"
component_coder_ids: "cENBllJboPTimestampedValueCoder"
>
>
coders: <
key: "cENBllJboPKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "cENBllJboPVarIntCoder"
component_coder_ids: "cENBllJboPIterableCoder"
>
>
coders: <
key: "cENBllJboPRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$db1c8903-b889-444c-9e52-3e74dcb843d1"
>
>
>
coders: <
key: "cENBllJboPTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\211^\007\207sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\266\333\274L'\032:I8^\021j\003\320N\321\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "cENBllJboPVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "cENBllJboPVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "cENBllJboPbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-pFrvPrvBZscGaq2xJ9SzEX_1vnW6-sGnNIKvrzkU3MY.jar\022@a45aef3ebbc166c7066aadb127d4b3117ff5be75bafac1a73482afaf3914dcc6"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-pFrvPrvBZscGaq2xJ9SzEX_1vnW6-sGnNIKvrzkU3MY.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/14 11:20:34 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1699960834425457917
2023/11/14 11:20:37 Prepared job with id: go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c and staging token: go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c
2023/11/14 11:20:37 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c
2023/11/14 11:20:37 Submitted job: go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c
2023/11/14 11:20:37 Job[go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c] state: STOPPED
2023/11/14 11:20:37 Job[go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c] state: STARTING
2023/11/14 11:20:37 Job[go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c] state: RUNNING
2023/11/14 11:20:37 2023-11-14 11:20:37. (1): ==================== <function annotate_downstream_side_inputs at 0x7ff30af430d0> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (2): ==================== <function fix_side_input_pcoll_coders at 0x7ff30af431f0> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (3): ==================== <function pack_combiners at 0x7ff30af43700> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (4): ==================== <function lift_combiners at 0x7ff30af43790> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (5): ==================== <function expand_sdf at 0x7ff30af43940> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (6): ==================== <function expand_gbk at 0x7ff30af439d0> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (7): ==================== <function sink_flattens at 0x7ff30af43af0> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (8): ==================== <function greedily_fuse at 0x7ff30af43b80> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (9): ==================== <function read_to_impulse at 0x7ff30af43c10> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (10): ==================== <function impulse_to_input at 0x7ff30af43ca0> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (11): ==================== <function sort_stages at 0x7ff30af43ee0> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7ff30af45040> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (13): ==================== <function setup_timer_mapping at 0x7ff30af43e50> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (14): ==================== <function populate_data_channel_coders at 0x7ff30af43f70> ====================
2023/11/14 11:20:37 2023-11-14 11:20:37. (15): starting control server on port 42201
2023/11/14 11:20:37 2023-11-14 11:20:37. (16): starting data server on port 40653
2023/11/14 11:20:37 2023-11-14 11:20:37. (17): starting state server on port 36625
2023/11/14 11:20:37 2023-11-14 11:20:37. (18): starting logging server on port 41393
2023/11/14 11:20:37 2023-11-14 11:20:37. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff33f8628e0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/14 11:20:40 2023-11-14 11:20:40. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/14 11:20:41 2023-11-14 11:20:41. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/14 11:20:41 2023-11-14 11:20:41. (22): Waiting for docker to start up. Current status is running
2023/11/14 11:20:41 2023-11-14 11:20:41. (23): Docker container is running. container_id = b'741e50ea1de4be0ae46911cc51e52549633a80ef6fb7ebfd4a62a7363c8df9ac', worker_id = worker_18
2023/11/14 11:20:42 2023-11-14 11:20:42. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff33f8bca60> for environment cENBllJboPbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/14 11:20:43 2023-11-14 11:20:43. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/14 11:20:43 2023-11-14 11:20:43. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/14 11:20:43 2023-11-14 11:20:43. (27): Waiting for docker to start up. Current status is running
2023/11/14 11:20:43 2023-11-14 11:20:43. (28): Docker container is running. container_id = b'2ba26c7aa5f03e231c2c7eb349900790f074c5d7033c813fb1dee57bce570e9c', worker_id = worker_19
2023/11/14 11:20:56 2023-11-14 11:20:56. (29): Completed job in 18.696285486221313 seconds with state DONE.
2023/11/14 11:20:56 Job[go-testjdbcio_postgresreadwrite-815-e49da3ef-0f2d-4e35-b1f0-909bfab25e3c] state: DONE
2023/11/14 11:20:56 🐳 Terminating container: cb6701247000
2023/11/14 11:20:56 🚫 Container terminated: cb6701247000
--- PASS: TestJDBCIO_PostgresReadWrite (46.71s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 135.109s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 36549
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpwgtn6zgh/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 37425
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 18s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/p33iyfdhr2xji
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4818
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4818/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:00 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:00 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:00 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:02 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:02 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:02 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f5ce608ab80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f5ce608ac10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f5ce608e3a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f3897b9a0d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f3897b9a1f0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f3897b9a700> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f3897b9a790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f3897b9a940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f3897b9a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f3897b9aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f3897b9ab80> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f3897b9ac10> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f3897b9aca0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f3897b9aee0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f3897b9b040> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f3897b9ae50> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f3897b9af70> ====================
INFO root:portable_runner.py:543 starting control server on port 34903
INFO root:portable_runner.py:543 starting data server on port 44783
INFO root:portable_runner.py:543 starting state server on port 42383
INFO root:portable_runner.py:543 starting logging server on port 45973
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f38afd99c70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'44b8f93541d7d208228d7099577bd5de6260ba7606d0d93bbb98affd3d443554', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f38cb456bb0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'86d03666026e1802fab962f2b6d838ef8256a319e69025c8f111200865578ab9', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.166102886199951 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '41427' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:41427
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:26 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:27 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:27 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:28 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:30 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 14, 2023 5:38:31 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f5ce608ab80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f5ce608ac10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f5ce608e3a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f3897b9a0d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f3897b9a1f0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f3897b9a700> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f3897b9a790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f3897b9a940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f3897b9a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f3897b9aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f3897b9ab80> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f3897b9ac10> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f3897b9aca0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f3897b9aee0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f3897b9b040> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f3897b9ae50> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f3897b9af70> ====================
INFO root:portable_runner.py:543 starting control server on port 45603
INFO root:portable_runner.py:543 starting data server on port 46655
INFO root:portable_runner.py:543 starting state server on port 38503
INFO root:portable_runner.py:543 starting logging server on port 38109
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f38caf93f10> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'666d783477d1fd108261d456b83e49fa56ab28da7874a4538a051137b210b2c3', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f38caf94760> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ad49ccb64bd210b89d79f2179dfea0ec715e178b4aa2ddfbe2219b680cd52450', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.15047550201416 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7228 deselected in 258.21s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1862646
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1863932.
Stopping expansion service pid: 1863933.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 31s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/oikhxxyaaeoeq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4817
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4817/display/redirect>
Changes:
------------------------------------------
[...truncated 1.33 MB...]
>
>
>
coders: <
key: "vvQNcWuZnJIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "vvQNcWuZnJTimestampedValueCoder"
>
>
coders: <
key: "vvQNcWuZnJKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vvQNcWuZnJVarIntCoder"
component_coder_ids: "vvQNcWuZnJRowCoder"
>
>
coders: <
key: "vvQNcWuZnJKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vvQNcWuZnJVarIntCoder"
component_coder_ids: "vvQNcWuZnJTimestampedValueCoder"
>
>
coders: <
key: "vvQNcWuZnJKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vvQNcWuZnJVarIntCoder"
component_coder_ids: "vvQNcWuZnJIterableCoder"
>
>
coders: <
key: "vvQNcWuZnJRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$8db2d2a4-ace5-4bd5-8625-1f933b8dc6d3"
>
>
>
coders: <
key: "vvQNcWuZnJTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\334\033\332\241sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\207\225?\365\250\376\035\217\366)U\233g\362O\241\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "vvQNcWuZnJVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "vvQNcWuZnJVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "vvQNcWuZnJbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-pFrvPrvBZscGaq2xJ9SzEX_1vnW6-sGnNIKvrzkU3MY.jar\022@a45aef3ebbc166c7066aadb127d4b3117ff5be75bafac1a73482afaf3914dcc6"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-pFrvPrvBZscGaq2xJ9SzEX_1vnW6-sGnNIKvrzkU3MY.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/13 23:21:28 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1699917688416492964
2023/11/13 23:21:31 Prepared job with id: go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924 and staging token: go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924
2023/11/13 23:21:31 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924
2023/11/13 23:21:31 Submitted job: go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924
2023/11/13 23:21:31 2023-11-13 23:21:31. (5): ==================== <function expand_sdf at 0x7f76eccad940> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (6): ==================== <function expand_gbk at 0x7f76eccad9d0> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (7): ==================== <function sink_flattens at 0x7f76eccadaf0> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (8): ==================== <function greedily_fuse at 0x7f76eccadb80> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (9): ==================== <function read_to_impulse at 0x7f76eccadc10> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (10): ==================== <function impulse_to_input at 0x7f76eccadca0> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (11): ==================== <function sort_stages at 0x7f76eccadee0> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f76eccae040> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (13): ==================== <function setup_timer_mapping at 0x7f76eccade50> ====================
2023/11/13 23:21:31 2023-11-13 23:21:31. (14): ==================== <function populate_data_channel_coders at 0x7f76eccadf70> ====================
2023/11/13 23:21:31 Job[go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924] state: STOPPED
2023/11/13 23:21:31 Job[go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924] state: STARTING
2023/11/13 23:21:31 Job[go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924] state: RUNNING
2023/11/13 23:21:31 2023-11-13 23:21:31. (15): starting control server on port 33173
2023/11/13 23:21:31 2023-11-13 23:21:31. (16): starting data server on port 36993
2023/11/13 23:21:31 2023-11-13 23:21:31. (17): starting state server on port 37391
2023/11/13 23:21:31 2023-11-13 23:21:31. (18): starting logging server on port 37617
2023/11/13 23:21:31 2023-11-13 23:21:31. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77203e1c70> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/13 23:21:38 2023-11-13 23:21:38. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/13 23:21:38 2023-11-13 23:21:38. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/13 23:21:43 2023-11-13 23:21:43. (22): Waiting for docker to start up. Current status is running
2023/11/13 23:21:43 2023-11-13 23:21:43. (23): Docker container is running. container_id = b'63415ef8aa4e250fd4304e85cdc38ee26f5c871257386289fca8089eec74173b', worker_id = worker_13
2023/11/13 23:21:44 2023-11-13 23:21:44. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f76e83878b0> for environment vvQNcWuZnJbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/13 23:21:47 2023-11-13 23:21:47. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/13 23:21:47 2023-11-13 23:21:47. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/13 23:21:49 2023-11-13 23:21:49. (27): Waiting for docker to start up. Current status is running
2023/11/13 23:21:49 2023-11-13 23:21:49. (28): Docker container is running. container_id = b'863b4106c57aa31f6c39147d4a0012bfabefe20d819fe24c15a2d584191cf050', worker_id = worker_15
2023/11/13 23:21:57 2023-11-13 23:21:57. (29): Completed job in 25.77400827407837 seconds with state DONE.
2023/11/13 23:21:57 Job[go-testjdbcio_postgresreadwrite-155-e9e7e9b5-a122-4af6-a427-d026d4c5d924] state: DONE
2023/11/13 23:21:57 🐳 Terminating container: a373beaa286c
2023/11/13 23:21:57 🚫 Container terminated: a373beaa286c
--- PASS: TestJDBCIO_PostgresReadWrite (53.66s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 108.166s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 36103
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0rc5-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp8un70a8r/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0rc5" for Docker environment
INFO:__main__:Listening for expansion requests at 35981
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 31m 19s
258 actionable tasks: 172 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/3imaq3hv4jj6y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4816
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4816/display/redirect>
Changes:
------------------------------------------
[...truncated 1.60 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:25 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:27 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:27 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:27 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa84c4dab80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa84c4dac10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa84c4dc3a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f646c2050d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f646c2051f0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f646c205700> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f646c205790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f646c205940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f646c2059d0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f646c205af0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f646c205b80> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f646c205c10> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f646c205ca0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f646c205ee0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f646c206040> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f646c205e50> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f646c205f70> ====================
INFO root:portable_runner.py:543 starting control server on port 46801
INFO root:portable_runner.py:543 starting data server on port 43533
INFO root:portable_runner.py:543 starting state server on port 37517
INFO root:portable_runner.py:543 starting logging server on port 44777
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f649fd42130> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd2783ea1ea3a425609568725d995e72ce7c5b124bcd232b31373335040bd90b5', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f64a01d7e20> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e496ca331fbfbc8c87a75ebb49b19ee0334a47ef3332cafb5fdf723e489f8e41', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.904759883880615 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '46281' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:46281
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:51 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:52 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:52 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:52 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:54 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 13, 2023 5:40:56 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa84c4dab80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa84c4dac10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa84c4dc3a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f646c2050d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f646c2051f0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f646c205700> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f646c205790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f646c205940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f646c2059d0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f646c205af0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f646c205b80> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f646c205c10> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f646c205ca0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f646c205ee0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f646c206040> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f646c205e50> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f646c205f70> ====================
INFO root:portable_runner.py:543 starting control server on port 45169
INFO root:portable_runner.py:543 starting data server on port 33427
INFO root:portable_runner.py:543 starting state server on port 34903
INFO root:portable_runner.py:543 starting logging server on port 38491
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f649fddc040> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a787713d7847c82110c35eedbdc57ec7a49b0a7b889f6430dbf23e6a6f883274', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f649fde77f0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'9c72b5d1c08fcbf238a4ad6344c15b94c93baa0d99342b4eb5e693b6f32ef959', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.052895545959473 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7228 deselected in 258.30s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1055755
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1056289.
Stopping expansion service pid: 1056290.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 30m 58s
258 actionable tasks: 179 executed, 69 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/w3k2yrszxs2z4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4815
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4815/display/redirect?page=changes>
Changes:
[noreply] Add getters to CheckResult in IT framework (#29411)
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8fa5b19f5468c716e16c688994b538cc2abd3811 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8fa5b19f5468c716e16c688994b538cc2abd3811 # timeout=10
Commit message: "Add getters to CheckResult in IT framework (#29411)"
> git rev-list --no-walk 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins5559383483030138371.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 17s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/nyqh2uzbnkv6w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4814
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4814/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2ad459113134dfffd3caeeb15e821bb644e08663 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
Commit message: "[YAML] - Kafka Read and Write proto (#29368)"
> git rev-list --no-walk 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins3430474936596337370.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 17s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/nyvp66qix6q6q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4813
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4813/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2ad459113134dfffd3caeeb15e821bb644e08663 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
Commit message: "[YAML] - Kafka Read and Write proto (#29368)"
> git rev-list --no-walk 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins336518316726346356.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 15s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/5wryydrknpvki
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4812
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4812/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2ad459113134dfffd3caeeb15e821bb644e08663 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
Commit message: "[YAML] - Kafka Read and Write proto (#29368)"
> git rev-list --no-walk 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins3047015698407578740.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 16s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/4762kyludrrtc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4811
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4811/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2ad459113134dfffd3caeeb15e821bb644e08663 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
Commit message: "[YAML] - Kafka Read and Write proto (#29368)"
> git rev-list --no-walk 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins9039849167793943159.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 16s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/4q3rurnnebpaa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4810
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4810/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2ad459113134dfffd3caeeb15e821bb644e08663 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2ad459113134dfffd3caeeb15e821bb644e08663 # timeout=10
Commit message: "[YAML] - Kafka Read and Write proto (#29368)"
> git rev-list --no-walk 39986e60ea367566da1f4a49d34a53f7ba75cf98 # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins14977599773928018018.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 17s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/7irmb2m6xatl4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4809
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4809/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 39986e60ea367566da1f4a49d34a53f7ba75cf98 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 39986e60ea367566da1f4a49d34a53f7ba75cf98 # timeout=10
Commit message: "Update image tag pattern for RCs in release docs (#29406)"
> git rev-list --no-walk 39986e60ea367566da1f4a49d34a53f7ba75cf98 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins10410662642024150537.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 17s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/lfzpn7rv3eams
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4808
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4808/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 39986e60ea367566da1f4a49d34a53f7ba75cf98 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 39986e60ea367566da1f4a49d34a53f7ba75cf98 # timeout=10
Commit message: "Update image tag pattern for RCs in release docs (#29406)"
> git rev-list --no-walk 1e1c2a319f6e873070a2e848341555700706cc2a # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins2920202126240561642.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 16s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/brcayv3xgpeto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4807
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4807/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1e1c2a319f6e873070a2e848341555700706cc2a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1e1c2a319f6e873070a2e848341555700706cc2a # timeout=10
Commit message: "Invoke pyarrow_hotfix to alleviate concerns due to CVE-2023-47248. (#29396)"
> git rev-list --no-walk 1e1c2a319f6e873070a2e848341555700706cc2a # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins18127230194472512143.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 16s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/om5mwlwghzz3m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4806
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4806/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1e1c2a319f6e873070a2e848341555700706cc2a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1e1c2a319f6e873070a2e848341555700706cc2a # timeout=10
Commit message: "Invoke pyarrow_hotfix to alleviate concerns due to CVE-2023-47248. (#29396)"
> git rev-list --no-walk 1e1c2a319f6e873070a2e848341555700706cc2a # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins6455599888355752869.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/e7blhvkaruvdo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4805
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4805/display/redirect>
Changes:
------------------------------------------
Started by timer
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-12 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Using shallow clone with depth 1
Avoid fetching tags
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Using shallow fetch with depth 1
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --no-tags --force --progress --depth=1 -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1e1c2a319f6e873070a2e848341555700706cc2a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1e1c2a319f6e873070a2e848341555700706cc2a # timeout=10
Commit message: "Invoke pyarrow_hotfix to alleviate concerns due to CVE-2023-47248. (#29396)"
> git rev-list --no-walk 87ca6140c3b023daada11d60ea5a1142a6289b5d # timeout=10
First time build. Skipping changelog.
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SETUPTOOLS_USE_DISTUTILS=stdlib
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Direct] $ /bin/bash -xe /tmp/jenkins18222325964733324018.sh
+ echo '*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***'
*** RUN CROSS-LANGUAGE DIRECT USING PYTHON 3.8 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.8 -PskipNonPythonTask=false :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunner
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.4/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build
Configuration on demand is an incubating feature.
Gradle Enterprise plugins resolution: https://plugins.gradle.org/m2
Enforcing Gradle Enterprise: https://ge.apache.org, allowUntrustedServer: false
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Configure project :sdks:go:container
docker-pull-licenses set, running go-licenses
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.4
go: downloading golang.org/dl v0.0.0-20231107201224-8165dcd93058
/home/jenkins/go/pkg/mod/golang.org/dl@v0.0.0-20231107201224-8165dcd93058/go1.21.4/main.go:20:8: //go:build comment without // +build comment
FAILURE: Build failed with an exception.
* What went wrong:
Could not determine the dependencies of task ':sdks:go:container:goBuild'.
> Could not create task ':sdks:go:container:goPrepare'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 2m 31s
4 actionable tasks: 3 executed, 1 from cache
Publishing build scan...
https://ge.apache.org/s/ymqxy7jks6pnc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4804
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4804/display/redirect>
Changes:
------------------------------------------
[...truncated 1.56 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:35:57 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:35:57 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:35:57 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:35:59 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:35:59 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:35:59 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fac789d13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fac789d1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fac789d1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8efff77940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8efff77a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8efff77f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8efff75040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8efff751f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8efff75280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8efff753a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8efff75430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8efff754c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8efff75550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8efff75790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8efff758b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8efff75700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8efff75820> ====================
INFO root:portable_runner.py:543 starting control server on port 42971
INFO root:portable_runner.py:543 starting data server on port 45785
INFO root:portable_runner.py:543 starting state server on port 43601
INFO root:portable_runner.py:543 starting logging server on port 43167
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f335711c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'26df68b2d7328c8d814cf2ba04da55f2b6c3b1108de8790bee47b91d17e3b888', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f335af490> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a816ddf6ae92b0ec7a5e1b5d13b226637694b93f0f2de2cf113106a18355ec2c', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.865247249603271 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '40341' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:40341
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:36:23 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:36:23 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:36:23 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:36:25 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 05, 2023 5:36:27 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fac789d13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fac789d1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fac789d1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8efff77940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8efff77a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8efff77f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8efff75040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8efff751f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8efff75280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8efff753a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8efff75430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8efff754c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8efff75550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8efff75790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8efff758b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8efff75700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8efff75820> ====================
INFO root:portable_runner.py:543 starting control server on port 35897
INFO root:portable_runner.py:543 starting data server on port 45135
INFO root:portable_runner.py:543 starting state server on port 45107
INFO root:portable_runner.py:543 starting logging server on port 43963
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f335777c0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ebf4dae73d25c2a3d5b7064063dc8269568abe2bf31bdc897757308f4fb2227a', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f3350c400> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ca8624b562218065fbe348a1f3a9e9b44f0c9744db822b5b5ae113361572d4ae', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 14.090643882751465 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 249.67s (0:04:09) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1006325
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1007241.
Stopping expansion service pid: 1007242.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 26s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/5ehcdqiqamgb4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4803
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4803/display/redirect>
Changes:
------------------------------------------
[...truncated 1.49 MB...]
component_coder_ids: "GMOqGpNzAaTimestampedValueCoder"
>
>
coders: <
key: "GMOqGpNzAaKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "GMOqGpNzAaVarIntCoder"
component_coder_ids: "GMOqGpNzAaIterableCoder"
>
>
coders: <
key: "GMOqGpNzAaRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$59db48de-484b-4107-8067-55171f046a7e"
>
>
>
coders: <
key: "GMOqGpNzAaTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006f\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000HqR\031sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\255\203\310?n E\010p\324\342\312&\025I\237\005e\010\014srVo\001\205\366\004s.\001\313\371\216,s$9z\2164\213\005/\271\347\002\005\324\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "GMOqGpNzAaVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "GMOqGpNzAaVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "GMOqGpNzAabeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar\022@e45913237b3908d09bd3aa1cb41250aabe3a281838991a12f791c85f720ff6ce"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/04 23:20:02 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1699140002995182091
2023/11/04 23:20:05 Prepared job with id: go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441 and staging token: go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441
2023/11/04 23:20:05 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441
2023/11/04 23:20:05 Submitted job: go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441
2023/11/04 23:20:05 Job[go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441] state: STOPPED
2023/11/04 23:20:05 Job[go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441] state: STARTING
2023/11/04 23:20:05 Job[go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441] state: RUNNING
2023/11/04 23:20:05 2023-11-04 23:20:05. (1): ==================== <function annotate_downstream_side_inputs at 0x7f82a7e49940> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f82a7e49a60> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (3): ==================== <function pack_combiners at 0x7f82a7e49f70> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (4): ==================== <function lift_combiners at 0x7f82a7e47040> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (5): ==================== <function expand_sdf at 0x7f82a7e471f0> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (6): ==================== <function expand_gbk at 0x7f82a7e47280> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (7): ==================== <function sink_flattens at 0x7f82a7e473a0> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (8): ==================== <function greedily_fuse at 0x7f82a7e47430> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (9): ==================== <function read_to_impulse at 0x7f82a7e474c0> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (10): ==================== <function impulse_to_input at 0x7f82a7e47550> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (11): ==================== <function sort_stages at 0x7f82a7e47790> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f82a7e478b0> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (13): ==================== <function setup_timer_mapping at 0x7f82a7e47700> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (14): ==================== <function populate_data_channel_coders at 0x7f82a7e47820> ====================
2023/11/04 23:20:05 2023-11-04 23:20:05. (15): starting control server on port 34999
2023/11/04 23:20:05 2023-11-04 23:20:05. (16): starting data server on port 44855
2023/11/04 23:20:05 2023-11-04 23:20:05. (17): starting state server on port 39825
2023/11/04 23:20:05 2023-11-04 23:20:05. (18): starting logging server on port 38119
2023/11/04 23:20:05 2023-11-04 23:20:05. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f82dc1d7190> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/04 23:20:05 2023-11-04 23:20:05. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/04 23:20:06 2023-11-04 23:20:06. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/04 23:20:09 2023-11-04 23:20:09. (22): Waiting for docker to start up. Current status is running
2023/11/04 23:20:09 2023-11-04 23:20:09. (23): Docker container is running. container_id = b'19d15b3c6630f61fdc953663ecc97377a89b1f59bdc17691932e536e495ba64e', worker_id = worker_16
2023/11/04 23:20:10 2023-11-04 23:20:10. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f82dc03b070> for environment GMOqGpNzAabeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/04 23:20:13 2023-11-04 23:20:13. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/04 23:20:13 2023-11-04 23:20:13. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/04 23:20:14 2023-11-04 23:20:14. (27): Waiting for docker to start up. Current status is running
2023/11/04 23:20:14 2023-11-04 23:20:14. (28): Docker container is running. container_id = b'a21699dfa850218cd826f0fa3e95e844faa5d1575df7ff13952c80a195fe1f53', worker_id = worker_18
2023/11/04 23:20:20 2023-11-04 23:20:20. (29): Completed job in 14.292779922485352 seconds with state DONE.
2023/11/04 23:20:20 Job[go-testjdbcio_postgresreadwrite-742-f2d3907a-9f82-470b-9843-316e4e911441] state: DONE
2023/11/04 23:20:20 🐳 Terminating container: 2e04281aedab
2023/11/04 23:20:20 🚫 Container terminated: 2e04281aedab
--- PASS: TestJDBCIO_PostgresReadWrite (39.91s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 94.762s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40389
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpjn4vtfgm/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38661
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 25m 50s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/2ysrycqdko5cq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4802
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4802/display/redirect>
Changes:
------------------------------------------
[...truncated 1.57 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:35:42 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:35:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:35:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:35:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:35:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:35:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0ad6f0f1f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0ad6f0f280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0ad6f0f9d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f5f264e0940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5f264e0a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5f264e0f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5f264e3040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5f264e31f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5f264e3280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5f264e33a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5f264e3430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5f264e34c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5f264e3550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5f264e3790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5f264e38b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5f264e3700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f5f264e3820> ====================
INFO root:portable_runner.py:543 starting control server on port 33935
INFO root:portable_runner.py:543 starting data server on port 37165
INFO root:portable_runner.py:543 starting state server on port 45767
INFO root:portable_runner.py:543 starting logging server on port 39611
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5f4b69f430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'95eacefde75134c9772435e90cb542dcb8bc0ac7ccca4a9fd0a9ad55274f8842', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5f59721a30> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'659a84f05884c6fc0730312246835bbcc986871cd74917a97095f9b8cc0ee8eb', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.62913703918457 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '54693' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:54693
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:36:07 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:36:08 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:36:08 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:36:08 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:36:10 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:36:12 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0ad6f0f1f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0ad6f0f280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0ad6f0f9d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f5f264e0940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5f264e0a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5f264e0f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5f264e3040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5f264e31f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5f264e3280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5f264e33a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5f264e3430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5f264e34c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5f264e3550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5f264e3790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5f264e38b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5f264e3700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f5f264e3820> ====================
INFO root:portable_runner.py:543 starting control server on port 42421
INFO root:portable_runner.py:543 starting data server on port 37861
INFO root:portable_runner.py:543 starting state server on port 37825
INFO root:portable_runner.py:543 starting logging server on port 32817
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5f4b68ff70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'1ff3343463e9120f07fae254ab0fc46660e5f2ed136fa380e118e93067dcbac6', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5f4afce1f0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'debadbf36c933a2088cebc96d3646b29b1213ffd48c4b5df2fd543c310d29523', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.652404546737671 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 246.83s (0:04:06) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 241834
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 242353.
Stopping expansion service pid: 242354.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 16s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/gcxcrxo37glae
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4801
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4801/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:35:38 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:35:38 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:35:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:35:40 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:35:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:35:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f79d64b71f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f79d64b7280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f79d64b79d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f415d307940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f415d307a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f415d307f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f415d154040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f415d1541f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f415d154280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f415d1543a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f415d154430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f415d1544c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f415d154550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f415d154790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f415d1548b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f415d154700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f415d154820> ====================
INFO root:portable_runner.py:543 starting control server on port 43991
INFO root:portable_runner.py:543 starting data server on port 35949
INFO root:portable_runner.py:543 starting state server on port 46617
INFO root:portable_runner.py:543 starting logging server on port 35789
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4191a61970> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f657a31e890a25265b33328544495f962a280f27f1b01b891593168df4cda3d5', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4191ad9130> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0ebeb7b0e2137ed89c3687141bfccba5337e248f1543675a4cabf18b4929ef14', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.40740156173706 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '45963' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:45963
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:36:03 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:36:03 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:36:04 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:36:04 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:36:06 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 11:36:07 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f79d64b71f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f79d64b7280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f79d64b79d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f415d307940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f415d307a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f415d307f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f415d154040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f415d1541f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f415d154280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f415d1543a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f415d154430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f415d1544c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f415d154550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f415d154790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f415d1548b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f415d154700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f415d154820> ====================
INFO root:portable_runner.py:543 starting control server on port 44101
INFO root:portable_runner.py:543 starting data server on port 40149
INFO root:portable_runner.py:543 starting state server on port 41123
INFO root:portable_runner.py:543 starting logging server on port 45543
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f41917fe3d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0dfc6f8937f486689f022064b96c200e76d44426231ace8acd68fe1103aeeb7b', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f41917d03a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e1d6a6c34658d41a88a48cc834a85c2aeb97c1d030c2ac83625ee3bdc794dadb', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 13.878092527389526 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 240.74s (0:04:00) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 6941
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 8964.
Stopping expansion service pid: 8965.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 6s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/kync6glvfp5wo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4800
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4800/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:04 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:05 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:06 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:06 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f219cb881f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f219cb88280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f219cb889d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4dc37d8940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4dc37d8a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4dc37d8f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4dc37d9040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4dc37d91f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4dc37d9280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4dc37d93a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4dc37d9430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4dc37d94c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4dc37d9550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4dc37d9790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4dc37d98b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4dc37d9700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4dc37d9820> ====================
INFO root:portable_runner.py:543 starting control server on port 39409
INFO root:portable_runner.py:543 starting data server on port 42365
INFO root:portable_runner.py:543 starting state server on port 46283
INFO root:portable_runner.py:543 starting logging server on port 46451
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4de11e6280> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'507a02cf5639a504cbc4123c08880be1cff7d2a31c26893e2479e303aace89b6', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4df707e400> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e771f83cee6f07c9f59a05a9a1aa9dbc0cb1610663f2a870b5e22cd69bf125f8', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.327152967453003 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '34589' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:34589
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:29 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:30 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:33 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 04, 2023 5:38:35 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f219cb881f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f219cb88280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f219cb889d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4dc37d8940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4dc37d8a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4dc37d8f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4dc37d9040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4dc37d91f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4dc37d9280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4dc37d93a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4dc37d9430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4dc37d94c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4dc37d9550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4dc37d9790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4dc37d98b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4dc37d9700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4dc37d9820> ====================
INFO root:portable_runner.py:543 starting control server on port 42039
INFO root:portable_runner.py:543 starting data server on port 46277
INFO root:portable_runner.py:543 starting state server on port 44525
INFO root:portable_runner.py:543 starting logging server on port 44371
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4de11c6c70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bce18c1d65c1c4c42a8102933b1bd8927852d2eab5c43844983f8e81c4a0bac3', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4df707bfd0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'9527af39ca6e73647d6120b9c17bd01a04f0e4085d74c71d240f5d1479f9d613', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.470428943634033 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 259.82s (0:04:19) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 208895
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 209406.
Stopping expansion service pid: 209407.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 38s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/6hdi5sdttit46
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4799
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4799/display/redirect>
Changes:
------------------------------------------
[...truncated 1.51 MB...]
key: "nRMhMRtYcrIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "nRMhMRtYcrTimestampedValueCoder"
>
>
coders: <
key: "nRMhMRtYcrKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "nRMhMRtYcrVarIntCoder"
component_coder_ids: "nRMhMRtYcrRowCoder"
>
>
coders: <
key: "nRMhMRtYcrKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "nRMhMRtYcrVarIntCoder"
component_coder_ids: "nRMhMRtYcrTimestampedValueCoder"
>
>
coders: <
key: "nRMhMRtYcrKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "nRMhMRtYcrVarIntCoder"
component_coder_ids: "nRMhMRtYcrIterableCoder"
>
>
coders: <
key: "nRMhMRtYcrRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$63391917-cddc-497d-b6a0-24225384d3aa"
>
>
>
coders: <
key: "nRMhMRtYcrTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\037\326\256\007sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\267\250\272\216\201\253\013D\363\257\346\316\365\325K\373\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "nRMhMRtYcrVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "nRMhMRtYcrVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "nRMhMRtYcrbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar\022@e45913237b3908d09bd3aa1cb41250aabe3a281838991a12f791c85f720ff6ce"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/03 23:20:11 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1699053611069404319
2023/11/03 23:20:13 Prepared job with id: go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d and staging token: go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d
2023/11/03 23:20:13 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d
2023/11/03 23:20:13 Submitted job: go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d
2023/11/03 23:20:13 Job[go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d] state: STOPPED
2023/11/03 23:20:13 Job[go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d] state: STARTING
2023/11/03 23:20:13 Job[go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d] state: RUNNING
2023/11/03 23:20:13 2023-11-03 23:20:13. (1): ==================== <function annotate_downstream_side_inputs at 0x7f2696b13af0> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f2696b13c10> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (3): ==================== <function pack_combiners at 0x7f2696b14160> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (4): ==================== <function lift_combiners at 0x7f2696b141f0> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (5): ==================== <function expand_sdf at 0x7f2696b143a0> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (6): ==================== <function expand_gbk at 0x7f2696b14430> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (7): ==================== <function sink_flattens at 0x7f2696b14550> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (8): ==================== <function greedily_fuse at 0x7f2696b145e0> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (9): ==================== <function read_to_impulse at 0x7f2696b14670> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (10): ==================== <function impulse_to_input at 0x7f2696b14700> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (11): ==================== <function sort_stages at 0x7f2696b14940> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f2696b14a60> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (13): ==================== <function setup_timer_mapping at 0x7f2696b148b0> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (14): ==================== <function populate_data_channel_coders at 0x7f2696b149d0> ====================
2023/11/03 23:20:13 2023-11-03 23:20:13. (15): starting control server on port 34351
2023/11/03 23:20:13 2023-11-03 23:20:13. (16): starting data server on port 41683
2023/11/03 23:20:13 2023-11-03 23:20:13. (17): starting state server on port 41349
2023/11/03 23:20:13 2023-11-03 23:20:13. (18): starting logging server on port 41315
2023/11/03 23:20:13 2023-11-03 23:20:13. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26c842f910> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/03 23:20:13 2023-11-03 23:20:13. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/03 23:20:14 2023-11-03 23:20:14. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/03 23:20:17 2023-11-03 23:20:17. (22): Waiting for docker to start up. Current status is running
2023/11/03 23:20:17 2023-11-03 23:20:17. (23): Docker container is running. container_id = b'7793205a03cf54d7831b430e3d2a7b69690eb395a13371c58aca7eab84c9baee', worker_id = worker_16
2023/11/03 23:20:19 2023-11-03 23:20:18. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26c8524940> for environment nRMhMRtYcrbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/03 23:20:21 2023-11-03 23:20:21. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/03 23:20:22 2023-11-03 23:20:22. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/03 23:20:22 2023-11-03 23:20:22. (27): Waiting for docker to start up. Current status is running
2023/11/03 23:20:22 2023-11-03 23:20:22. (28): Docker container is running. container_id = b'54dcf5d1b76a0728c50acb64f0e03ea2c1801f0a20fb4302e5282babff8aa253', worker_id = worker_18
2023/11/03 23:20:28 2023-11-03 23:20:28. (29): Completed job in 14.649169206619263 seconds with state DONE.
2023/11/03 23:20:28 Job[go-testjdbcio_postgresreadwrite-115-fbd2de36-dad5-4566-9750-70718d7ef43d] state: DONE
2023/11/03 23:20:28 🐳 Terminating container: 4987918a1c1f
2023/11/03 23:20:28 🚫 Container terminated: 4987918a1c1f
--- PASS: TestJDBCIO_PostgresReadWrite (40.46s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 91.155s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38157
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpnsq832x3/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33503
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 33s
258 actionable tasks: 172 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ik6wvdi2ciare
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4798
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4798/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/bigquery from 1.57.0 to 1.57.1 in /sdks
------------------------------------------
[...truncated 1.35 MB...]
component_coder_ids: "OVBNynkzJnTimestampedValueCoder"
>
>
coders: <
key: "OVBNynkzJnKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "OVBNynkzJnVarIntCoder"
component_coder_ids: "OVBNynkzJnIterableCoder"
>
>
coders: <
key: "OVBNynkzJnRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$2fa59ba0-db63-494a-b8bc-cb691b0e64c6"
>
>
>
coders: <
key: "OVBNynkzJnTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\275\235\271~sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\222\251\372\377\334\331\257\331\3527\310P\227\372E\274\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "OVBNynkzJnVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "OVBNynkzJnVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "OVBNynkzJnbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar\022@e45913237b3908d09bd3aa1cb41250aabe3a281838991a12f791c85f720ff6ce"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/03 17:23:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1699032185732451758
2023/11/03 17:23:10 Prepared job with id: go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3 and staging token: go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3
2023/11/03 17:23:10 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3
2023/11/03 17:23:10 Submitted job: go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3
2023/11/03 17:23:10 Job[go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3] state: STOPPED
2023/11/03 17:23:10 Job[go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3] state: STARTING
2023/11/03 17:23:10 Job[go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3] state: RUNNING
2023/11/03 17:23:10 2023-11-03 17:23:10. (1): ==================== <function annotate_downstream_side_inputs at 0x7f677a823af0> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f677a823c10> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (3): ==================== <function pack_combiners at 0x7f677a822160> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (4): ==================== <function lift_combiners at 0x7f677a8221f0> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (5): ==================== <function expand_sdf at 0x7f677a8223a0> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (6): ==================== <function expand_gbk at 0x7f677a822430> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (7): ==================== <function sink_flattens at 0x7f677a822550> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (8): ==================== <function greedily_fuse at 0x7f677a8225e0> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (9): ==================== <function read_to_impulse at 0x7f677a822670> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (10): ==================== <function impulse_to_input at 0x7f677a822700> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (11): ==================== <function sort_stages at 0x7f677a822940> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f677a822a60> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (13): ==================== <function setup_timer_mapping at 0x7f677a8228b0> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (14): ==================== <function populate_data_channel_coders at 0x7f677a8229d0> ====================
2023/11/03 17:23:10 2023-11-03 17:23:10. (15): starting control server on port 46173
2023/11/03 17:23:10 2023-11-03 17:23:10. (16): starting data server on port 41879
2023/11/03 17:23:10 2023-11-03 17:23:10. (17): starting state server on port 32829
2023/11/03 17:23:10 2023-11-03 17:23:10. (18): starting logging server on port 36627
2023/11/03 17:23:10 2023-11-03 17:23:10. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f67aefa83d0> for environment OVBNynkzJnbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/03 17:23:12 2023-11-03 17:23:12. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/03 17:23:13 2023-11-03 17:23:13. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/03 17:23:14 2023-11-03 17:23:14. (22): Waiting for docker to start up. Current status is running
2023/11/03 17:23:14 2023-11-03 17:23:14. (23): Docker container is running. container_id = b'f43876eacd7e4be5058134e2f05182ead265a1a989ae0dd526487a7eed75fb84', worker_id = worker_16
2023/11/03 17:23:15 2023-11-03 17:23:15. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f67aefe40a0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/03 17:23:15 2023-11-03 17:23:15. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/03 17:23:15 2023-11-03 17:23:15. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/03 17:23:16 2023-11-03 17:23:16. (27): Waiting for docker to start up. Current status is running
2023/11/03 17:23:16 2023-11-03 17:23:16. (28): Docker container is running. container_id = b'5a2347d956cc6afc65169f55247a79f9821cf6f13595bfef98292849e9daef17', worker_id = worker_17
2023/11/03 17:23:22 2023-11-03 17:23:22. (29): Completed job in 12.16141653060913 seconds with state DONE.
2023/11/03 17:23:22 Job[go-testjdbcio_postgresreadwrite-210-d4d3a155-44d0-4803-a0ee-5a44a7e1b5a3] state: DONE
2023/11/03 17:23:22 🐳 Terminating container: ae0072fa6c4f
2023/11/03 17:23:23 🚫 Container terminated: ae0072fa6c4f
--- PASS: TestJDBCIO_PostgresReadWrite (44.32s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 124.842s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.032s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 45607
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpbqldr_zd/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 32851
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 52s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/7pjw2gl7zwetk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4797
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4797/display/redirect>
Changes:
------------------------------------------
[...truncated 1.56 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:36:54 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:36:55 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:36:55 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:36:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:36:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:36:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc606fb13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc606fb1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc606fb1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f0c11975af0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f0c11975c10> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f0c11976160> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f0c119761f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f0c119763a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f0c11976430> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f0c11976550> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f0c119765e0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f0c11976670> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f0c11976700> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f0c11976940> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f0c11976a60> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f0c119768b0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f0c119769d0> ====================
INFO root:portable_runner.py:543 starting control server on port 33279
INFO root:portable_runner.py:543 starting data server on port 39385
INFO root:portable_runner.py:543 starting state server on port 46207
INFO root:portable_runner.py:543 starting logging server on port 38253
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c4337eaf0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'df899dc250ab2a303ed97d573a9463eceef8a01e5af50f3917473467b713e90a', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c43383520> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'515b8a0fdf400308c84f983c30ace7efa5e325debe5c42295fee4621ed6b2f69', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.657986879348755 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '51727' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:51727
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:37:19 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:37:20 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:37:21 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:37:21 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:37:23 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 03, 2023 11:37:24 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc606fb13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc606fb1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc606fb1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f0c11975af0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f0c11975c10> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f0c11976160> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f0c119761f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f0c119763a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f0c11976430> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f0c11976550> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f0c119765e0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f0c11976670> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f0c11976700> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f0c11976940> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f0c11976a60> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f0c119768b0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f0c119769d0> ====================
INFO root:portable_runner.py:543 starting control server on port 36771
INFO root:portable_runner.py:543 starting data server on port 36693
INFO root:portable_runner.py:543 starting state server on port 33091
INFO root:portable_runner.py:543 starting logging server on port 37753
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c4337c0a0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'aaf502b67ad9ab5faa96ebb1a7f88ddfaf03a69277d3a9d6bff6463d83199d8c', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c4337e1c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'6c042cc19f8b2f86259ee4f4c0a5202b601c92b42b7a6ee314c6e1567ccecb38', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 14.163485765457153 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 243.93s (0:04:03) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 596454
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 597176.
Stopping expansion service pid: 597177.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 24s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/aswyakyp7rk62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4796
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4796/display/redirect>
Changes:
------------------------------------------
[...truncated 1.31 MB...]
component_coder_ids: "KGYPXxfTYoTimestampedValueCoder"
>
>
coders: <
key: "KGYPXxfTYoKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "KGYPXxfTYoVarIntCoder"
component_coder_ids: "KGYPXxfTYoIterableCoder"
>
>
coders: <
key: "KGYPXxfTYoRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$ed99f21f-8368-40ab-84ec-8ee9a26c7daa"
>
>
>
coders: <
key: "KGYPXxfTYoTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\275\235\271~sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\206\002\207\034\003\226\025\234\305*\202,j}F\217\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "KGYPXxfTYoVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "KGYPXxfTYoVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "KGYPXxfTYobeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar\022@e45913237b3908d09bd3aa1cb41250aabe3a281838991a12f791c85f720ff6ce"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-5FkTI3s5CNCb06octBJQqr46KBg4mRoS95HIX3IP9s4.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/03 05:20:40 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1698988840148293298
2023/11/03 05:20:44 Prepared job with id: go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d and staging token: go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d
2023/11/03 05:20:44 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d
2023/11/03 05:20:44 Submitted job: go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d
2023/11/03 05:20:44 Job[go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d] state: STOPPED
2023/11/03 05:20:44 Job[go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d] state: STARTING
2023/11/03 05:20:44 Job[go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d] state: RUNNING
2023/11/03 05:20:44 2023-11-03 05:20:44. (1): ==================== <function annotate_downstream_side_inputs at 0x7f2312921af0> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f2312921c10> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (3): ==================== <function pack_combiners at 0x7f2312922160> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (4): ==================== <function lift_combiners at 0x7f23129221f0> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (5): ==================== <function expand_sdf at 0x7f23129223a0> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (6): ==================== <function expand_gbk at 0x7f2312922430> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (7): ==================== <function sink_flattens at 0x7f2312922550> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (8): ==================== <function greedily_fuse at 0x7f23129225e0> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (9): ==================== <function read_to_impulse at 0x7f2312922670> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (10): ==================== <function impulse_to_input at 0x7f2312922700> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (11): ==================== <function sort_stages at 0x7f2312922940> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f2312922a60> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (13): ==================== <function setup_timer_mapping at 0x7f23129228b0> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (14): ==================== <function populate_data_channel_coders at 0x7f23129229d0> ====================
2023/11/03 05:20:44 2023-11-03 05:20:44. (15): starting control server on port 36129
2023/11/03 05:20:44 2023-11-03 05:20:44. (16): starting data server on port 38967
2023/11/03 05:20:44 2023-11-03 05:20:44. (17): starting state server on port 33415
2023/11/03 05:20:44 2023-11-03 05:20:44. (18): starting logging server on port 38559
2023/11/03 05:20:44 2023-11-03 05:20:44. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f23472520d0> for environment KGYPXxfTYobeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/03 05:20:44 2023-11-03 05:20:44. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/03 05:20:45 2023-11-03 05:20:45. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/03 05:20:49 2023-11-03 05:20:49. (22): Waiting for docker to start up. Current status is running
2023/11/03 05:20:49 2023-11-03 05:20:49. (23): Docker container is running. container_id = b'252049ec1f6855ebc0b1bac92ea4f59b20f034c7aab6fb55510d12b00d9f3b73', worker_id = worker_16
2023/11/03 05:20:50 2023-11-03 05:20:50. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f23467c7790> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/03 05:20:52 2023-11-03 05:20:52. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/03 05:20:52 2023-11-03 05:20:52. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/03 05:20:53 2023-11-03 05:20:53. (27): Waiting for docker to start up. Current status is running
2023/11/03 05:20:53 2023-11-03 05:20:53. (28): Docker container is running. container_id = b'198fd732edcce93b0b30a98369ee81aae741b37d047d7bd641e6ec15b8a40d43', worker_id = worker_18
2023/11/03 05:20:57 2023-11-03 05:20:57. (29): Completed job in 13.369863271713257 seconds with state DONE.
2023/11/03 05:20:57 Job[go-testjdbcio_postgresreadwrite-608-92b8ca4f-edf6-402c-af5d-8b2600c9640d] state: DONE
2023/11/03 05:20:57 🐳 Terminating container: 41a1d1d428e6
2023/11/03 05:20:58 🚫 Container terminated: 41a1d1d428e6
--- PASS: TestJDBCIO_PostgresReadWrite (43.58s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 108.530s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43475
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpvlh975j9/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 46661
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 4s
258 actionable tasks: 176 executed, 72 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/yw3lmj54bvrsy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4795
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4795/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:37:58 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:37:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:37:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feb4f1913a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feb4f191430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feb4f191b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff3a3ddbaf0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff3a3ddbc10> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff3a3ddd160> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff3a3ddd1f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff3a3ddd3a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff3a3ddd430> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff3a3ddd550> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff3a3ddd5e0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff3a3ddd670> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff3a3ddd700> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff3a3ddd940> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff3a3ddda60> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff3a3ddd8b0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff3a3ddd9d0> ====================
INFO root:portable_runner.py:543 starting control server on port 40041
INFO root:portable_runner.py:543 starting data server on port 37373
INFO root:portable_runner.py:543 starting state server on port 39885
INFO root:portable_runner.py:543 starting logging server on port 34499
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff3d7ebac10> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a0e86141f0a547ce44092f747f36007c6dbd51ceb547f7fa0aab96f339c25430', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff3d07eee80> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'08ad571cb693fe12a142e46ddd48b948956a88f45b8008ae2234de13d4f0f78c', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.649279832839966 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '42819' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:42819
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:22 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:24 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:24 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:24 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:26 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:38:27 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feb4f1913a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feb4f191430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feb4f191b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff3a3ddbaf0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff3a3ddbc10> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff3a3ddd160> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff3a3ddd1f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff3a3ddd3a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff3a3ddd430> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff3a3ddd550> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff3a3ddd5e0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff3a3ddd670> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff3a3ddd700> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff3a3ddd940> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff3a3ddda60> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff3a3ddd8b0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff3a3ddd9d0> ====================
INFO root:portable_runner.py:543 starting control server on port 34177
INFO root:portable_runner.py:543 starting data server on port 43863
INFO root:portable_runner.py:543 starting state server on port 44923
INFO root:portable_runner.py:543 starting logging server on port 35807
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff3d7f63850> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a0f7b2f298e4cf3fb0eee08d2bec3cae3a19a391b30a8128a513746dd19c2217', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff3d7e7baf0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'9db5a653e0d9bcba055831c042906093a037daab72f9ea0947a8e268bb2698b1', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.434004306793213 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 241.41s (0:04:01) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3722310
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3723365.
Stopping expansion service pid: 3723366.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 26s
258 actionable tasks: 172 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/mrk7zdbugs734
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4794
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4794/display/redirect>
Changes:
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:16 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:16 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:17 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:19 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:19 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:19 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe70d117310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe70d1173a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe70d117af0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe3468e7a60> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe3468e7b80> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe3467320d0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe346732160> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe346732310> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe3467323a0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe3467324c0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe346732550> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe3467325e0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe346732670> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe3467328b0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe3467329d0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe346732820> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe346732940> ====================
INFO root:portable_runner.py:543 starting control server on port 43921
INFO root:portable_runner.py:543 starting data server on port 38399
INFO root:portable_runner.py:543 starting state server on port 38097
INFO root:portable_runner.py:543 starting logging server on port 33681
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe371d0d550> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'45db60ad6e167a9e3bf0c79bca6dd8d372a73e00125123f3ab44daaf72bfc202', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe3445c2310> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0ca531815734ac558bfb00dc1914024f5d03d99458b45cc65e2303422858d1ba', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 19.876110792160034 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '40875' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:40875
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:49 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:51 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:51 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:51 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:53 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 5:46:55 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe70d117310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe70d1173a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe70d117af0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe3468e7a60> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe3468e7b80> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe3467320d0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe346732160> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe346732310> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe3467323a0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe3467324c0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe346732550> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe3467325e0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe346732670> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe3467328b0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe3467329d0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe346732820> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe346732940> ====================
INFO root:portable_runner.py:543 starting control server on port 33947
INFO root:portable_runner.py:543 starting data server on port 46323
INFO root:portable_runner.py:543 starting state server on port 44699
INFO root:portable_runner.py:543 starting logging server on port 35923
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe3445d58b0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2c42498ab766256755bc4441e3a906f783afbf81f15fd8adb4c2b2833b29a7e6', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe344618e50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7b880b88ab5cf185fcebe9afa304d240879144cdf905e805de2de7f7f4978994', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.573476552963257 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 335.32s (0:05:35) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3148282
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3152341.
Stopping expansion service pid: 3152342.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 34m 12s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/oxrntlu5gy6ca
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4793
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4793/display/redirect>
Changes:
------------------------------------------
[...truncated 1.74 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:53241.
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:53241.
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:53241.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:39:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:39:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:39:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:39:54 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:39:54 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:39:54 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f75a2e1a0d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f75a2e1a160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f75a2e1a8b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f03e7bed820> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f03e7bed940> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f03e7bede50> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f03e7bedee0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f03e7bea0d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f03e7bea160> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f03e7bea280> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f03e7bea310> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f03e7bea3a0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f03e7bea430> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f03e7bea670> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f03e7bea790> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f03e7bea5e0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f03e7bea700> ====================
INFO root:portable_runner.py:543 starting control server on port 35479
INFO root:portable_runner.py:543 starting data server on port 41327
INFO root:portable_runner.py:543 starting state server on port 42155
INFO root:portable_runner.py:543 starting logging server on port 37935
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f041b418220> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'87c99a45e495ce8e742c6923224a096c5e9dc2ed4c9ff61f74a285af361d04f8', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f041bf6a3d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'150518aa6ace92e7c4afdd0fad337cc4b0666665b83190f68ce8dfe4e24247d4', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.005275249481201 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57943' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:57943
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:40:23 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:96 Waiting for grpc channel to be ready at localhost:57943.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:40:26 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:40:26 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:40:27 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:40:29 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 02, 2023 11:40:31 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f75a2e1a0d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f75a2e1a160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f75a2e1a8b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f03e7bed820> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f03e7bed940> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f03e7bede50> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f03e7bedee0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f03e7bea0d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f03e7bea160> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f03e7bea280> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f03e7bea310> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f03e7bea3a0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f03e7bea430> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f03e7bea670> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f03e7bea790> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f03e7bea5e0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f03e7bea700> ====================
INFO root:portable_runner.py:543 starting control server on port 34767
INFO root:portable_runner.py:543 starting data server on port 44553
INFO root:portable_runner.py:543 starting state server on port 38103
INFO root:portable_runner.py:543 starting logging server on port 34027
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f03e79a8880> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a09e7f94844bb12a832f7a95e9f59bf335812d2794c8e98bd8710fb9121006df', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f041bee6790> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'05c96daa6e1b225e35cc287b020ff3d13112df06403db3e5979d04d404f244d5', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.080492973327637 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 343.97s (0:05:43) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4145714
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4146567.
Stopping expansion service pid: 4146568.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 30m 35s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ztq4chxo6mce6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4792
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4792/display/redirect?page=changes>
Changes:
[noreply] Fix ./gradlew spotlessApply fail groovy check (#29264)
------------------------------------------
[...truncated 152.71 KB...]
Using cached pytest_xdist-3.3.1-py3-none-any.whl.metadata (3.1 kB)
Collecting pytest-timeout<3,>=2.1.0
Using cached pytest_timeout-2.2.0-py3-none-any.whl.metadata (17 kB)
Collecting scikit-learn>=0.20.0
Using cached scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Collecting sqlalchemy<2.0,>=1.3
Using cached SQLAlchemy-1.4.50-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (10.0 kB)
Collecting psycopg2-binary<3.0.0,>=2.8.5
Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.4 kB)
Collecting testcontainers<4.0.0,>=3.0.3 (from testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached testcontainers-3.7.1-py2.py3-none-any.whl (45 kB)
Collecting cryptography>=41.0.2
Using cached cryptography-41.0.5-cp37-abi3-manylinux_2_28_x86_64.whl.metadata (5.2 kB)
Collecting hypothesis<=7.0.0,>5.0.0
Using cached hypothesis-6.88.1-py3-none-any.whl.metadata (5.9 kB)
Collecting six>=1.11.0 (from azure-core<2,>=1.7.0)
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting msal<2.0.0,>=1.24.0 (from azure-identity<2,>=1.12.0)
Using cached msal-1.24.1-py2.py3-none-any.whl.metadata (11 kB)
Collecting msal-extensions<2.0.0,>=0.3.0 (from azure-identity<2,>=1.12.0)
Using cached msal_extensions-1.0.0-py2.py3-none-any.whl (19 kB)
Collecting isodate>=0.6.1 (from azure-storage-blob<13,>=12.3.2)
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting botocore<1.32.0,>=1.31.76 (from boto3<2,>=1.9)
Using cached botocore-1.31.76-py3-none-any.whl.metadata (6.1 kB)
Collecting jmespath<2.0.0,>=0.7.1 (from boto3<2,>=1.9)
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.8.0,>=0.7.0 (from boto3<2,>=1.9)
Using cached s3transfer-0.7.0-py3-none-any.whl.metadata (1.8 kB)
Collecting cffi>=1.12 (from cryptography>=41.0.2)
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting googleapis-common-protos<2.0.dev0,>=1.56.2 (from google-api-core<3,>=2.0.0)
Using cached googleapis_common_protos-1.61.0-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting oauth2client>=1.4.12 (from google-apitools<0.5.32,>=0.5.31)
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1 (from google-auth<3,>=1.18.0)
Using cached pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
Collecting rsa<5,>=3.1.4 (from google-auth<3,>=1.18.0)
Using cached rsa-4.9-py3-none-any.whl (34 kB)
Collecting google-cloud-storage<3.0.0dev,>=1.32.0 (from google-cloud-aiplatform<2.0,>=1.26.0)
Using cached google_cloud_storage-2.13.0-py2.py3-none-any.whl.metadata (6.1 kB)
Collecting google-cloud-resource-manager<3.0.0dev,>=1.3.3 (from google-cloud-aiplatform<2.0,>=1.26.0)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting shapely<3.0.0dev (from google-cloud-aiplatform<2.0,>=1.26.0)
Using cached shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.0 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0 (from google-cloud-bigquery<4,>=2.0.0)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl.metadata (2.1 kB)
Collecting grpc-google-iam-v1<1.0.0dev,>=0.12.4 (from google-cloud-bigtable<3,>=2.19.0)
Using cached grpc_google_iam_v1-0.12.6-py2.py3-none-any.whl (26 kB)
Collecting grpcio-status>=1.33.2 (from google-cloud-pubsub<3,>=2.1.0)
Using cached grpcio_status-1.59.2-py3-none-any.whl.metadata (1.3 kB)
Collecting overrides<7.0.0,>=6.0.1 (from google-cloud-pubsublite<2,>=1.2.0)
Using cached overrides-6.5.0-py3-none-any.whl (17 kB)
Collecting sqlparse>=0.4.4 (from google-cloud-spanner<4,>=3.0.0)
Using cached sqlparse-0.4.4-py3-none-any.whl (41 kB)
Collecting docopt (from hdfs<3.0.0,>=2.1.0)
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 (from httplib2<0.23.0,>=0.8)
Using cached pyparsing-3.1.1-py3-none-any.whl.metadata (5.1 kB)
Collecting attrs>=19.2.0 (from hypothesis<=7.0.0,>5.0.0)
Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis<=7.0.0,>5.0.0)
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0)
Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB)
Collecting tzlocal>=1.2 (from js2py<1,>=0.74)
Using cached tzlocal-5.2-py3-none-any.whl.metadata (7.8 kB)
Collecting pyjsparser>=2.5.1 (from js2py<1,>=0.74)
Using cached pyjsparser-2.7.1-py3-none-any.whl
Collecting importlib-resources>=1.4.0 (from jsonschema<5.0.0,>=4.0.0)
Using cached importlib_resources-6.1.0-py3-none-any.whl.metadata (4.1 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema<5.0.0,>=4.0.0)
Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl.metadata (2.8 kB)
Collecting pkgutil-resolve-name>=1.3.10 (from jsonschema<5.0.0,>=4.0.0)
Using cached pkgutil_resolve_name-1.3.10-py3-none-any.whl (4.7 kB)
Collecting referencing>=0.28.4 (from jsonschema<5.0.0,>=4.0.0)
Using cached referencing-0.30.2-py3-none-any.whl.metadata (2.6 kB)
Collecting rpds-py>=0.7.1 (from jsonschema<5.0.0,>=4.0.0)
Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.7 kB)
Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0)
Using cached dnspython-2.4.2-py3-none-any.whl.metadata (4.9 kB)
Collecting iniconfig (from pytest<8.0,>=7.1.2)
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2) (1.3.0)
Requirement already satisfied: tomli>=1.0.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2) (2.0.1)
Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0)
Using cached execnet-2.0.2-py3-none-any.whl.metadata (2.9 kB)
Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0)
Using cached charset_normalizer-3.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0)
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0)
Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB)
Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0)
Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0)
Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0)
Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3)
Using cached greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.7 kB)
Collecting docker>=4.0.0 (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB)
Collecting wrapt (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting deprecation (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0)
Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2)
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached websocket_client-1.6.4-py3-none-any.whl.metadata (7.7 kB)
Collecting google-crc32c<2.0dev,>=1.0 (from google-cloud-storage<3.0.0dev,>=1.32.0->google-cloud-aiplatform<2.0,>=1.26.0)
Using cached google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB)
Requirement already satisfied: zipp>=3.1.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from importlib-resources>=1.4.0->jsonschema<5.0.0,>=4.0.0) (3.17.0)
Collecting PyJWT<3,>=1.0.0 (from PyJWT[crypto]<3,>=1.0.0->msal<2.0.0,>=1.24.0->azure-identity<2,>=1.12.0)
Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting portalocker<3,>=1.0 (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0)
Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Collecting pyasn1>=0.1.7 (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31)
Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74)
Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB)
Using cached azure_core-1.29.5-py3-none-any.whl (192 kB)
Using cached azure_identity-1.15.0-py3-none-any.whl (164 kB)
Using cached azure_storage_blob-12.19.0b1-py3-none-any.whl (394 kB)
Using cached boto3-1.28.76-py3-none-any.whl (135 kB)
Using cached cryptography-41.0.5-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB)
Using cached fastavro-1.9.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fasteners-0.19-py3-none-any.whl (18 kB)
Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB)
Using cached google_auth-2.23.4-py2.py3-none-any.whl (183 kB)
Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Using cached google_cloud_aiplatform-1.36.0-py2.py3-none-any.whl (3.1 MB)
Using cached google_cloud_bigquery-3.13.0-py2.py3-none-any.whl (222 kB)
Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB)
Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB)
Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB)
Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB)
Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB)
Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB)
Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB)
Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB)
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 kB)
Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB)
Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB)
Using cached google_cloud_vision-3.4.5-py2.py3-none-any.whl (444 kB)
Using cached grpcio-1.59.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB)
Using cached hypothesis-6.88.1-py3-none-any.whl (421 kB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached jsonschema-4.19.2-py3-none-any.whl (83 kB)
Using cached mock-5.1.0-py3-none-any.whl (30 kB)
Using cached numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
Using cached orjson-3.9.10-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Using cached proto_plus-1.23.0rc1-py3-none-any.whl (48 kB)
Using cached protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl (311 kB)
Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Using cached pyhamcrest-2.1.0-py3-none-any.whl (54 kB)
Using cached pymongo-4.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (693 kB)
Using cached pytest-7.4.3-py3-none-any.whl (325 kB)
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB)
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB)
Using cached scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
Using cached SQLAlchemy-1.4.50-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached zstandard-0.22.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB)
Using cached botocore-1.31.76-py3-none-any.whl (11.3 MB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Using cached charset_normalizer-3.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (141 kB)
Using cached dnspython-2.4.2-py3-none-any.whl (300 kB)
Using cached docker-6.1.3-py3-none-any.whl (148 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached execnet-2.0.2-py3-none-any.whl (37 kB)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB)
Using cached google_cloud_storage-2.13.0-py2.py3-none-any.whl (121 kB)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB)
Using cached googleapis_common_protos-1.61.0-py2.py3-none-any.whl (230 kB)
Using cached greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (618 kB)
Using cached grpcio_status-1.59.2-py3-none-any.whl (14 kB)
Using cached importlib_resources-6.1.0-py3-none-any.whl (33 kB)
Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB)
Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB)
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Using cached referencing-0.30.2-py3-none-any.whl (25 kB)
Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB)
Using cached shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tzlocal-5.2-py3-none-any.whl (17 kB)
Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB)
Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB)
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (82 kB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (pyproject.toml): started
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.53.0.dev0-cp38-cp38-linux_x86_64.whl size=16218583 sha256=21d45e8e9232b1db1a472bdf8db220b00c0c025cb539a356c4439d11f31d897f
Stored in directory: /home/jenkins/.cache/pip/wheels/c0/01/10/5a028b724cdf5b5d2643067a82afc4660de8e5639d060da291
Successfully built apache-beam
Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, threadpoolctl, tenacity, sqlparse, six, rpds-py, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, psycopg2-binary, protobuf, portalocker, pkgutil-resolve-name, parameterized, overrides, orjson, objsize, numpy, mock, joblib, jmespath, iniconfig, importlib-resources, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, backports.zoneinfo, attrs, tzlocal, sqlalchemy, shapely, scipy, rsa, requests, referencing, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, proto-plus, isodate, hypothesis, httplib2, googleapis-common-protos, google-resumable-media, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, oauth2client, jsonschema-specifications, js2py, hdfs, grpcio-status, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, jsonschema, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, msal, google-cloud-core, boto3, apache-beam, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity
Successfully installed PyJWT-2.8.0 apache-beam-2.53.0.dev0 attrs-23.1.0 azure-core-1.29.5 azure-identity-1.15.0 azure-storage-blob-12.19.0b1 backports.zoneinfo-0.2.1 boto3-1.28.76 botocore-1.31.76 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.2 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.5 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.9.0 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.4 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.36.0 google-cloud-bigquery-3.13.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.13.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.5 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.61.0 greenlet-3.0.1 grpc-google-iam-v1-0.12.6 grpcio-1.59.2 grpcio-status-1.59.2 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.88.1 idna-3.4 importlib-resources-6.1.0 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 jsonschema-4.19.2 jsonschema-specifications-2023.7.1 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.10 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 pkgutil-resolve-name-1.3.10 portalocker-2.8.2 proto-plus-1.23.0rc1 protobuf-4.24.4 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.1.0 pyjsparser-2.7.1 pymongo-4.6.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.3 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 referencing-0.30.2 regex-2023.10.3 requests-2.31.0 requests-mock-1.11.0 rpds-py-0.10.6 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.2 scipy-1.10.1 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.50 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.2 urllib3-1.26.18 websocket-client-1.6.4 wrapt-1.16.0rc1 zstandard-0.22.0
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
Waiting for server to start up...
Server started at port 40163
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3720668
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 6m 18s
251 actionable tasks: 168 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/6vpshhshg5zgy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4791
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4791/display/redirect>
Changes:
------------------------------------------
[...truncated 280.46 KB...]
Collecting msal-extensions<2.0.0,>=0.3.0 (from azure-identity<2,>=1.12.0)
Using cached msal_extensions-1.0.0-py2.py3-none-any.whl (19 kB)
> Task :sdks:python:container:py38:docker FAILED
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 5.00kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.3s
#4 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:ad7bb4f67d8a5966676b488ef2804ae51e34ca86d312d2549d1759d51fb7c360
#4 CACHED
#5 [internal] load build context
#5 transferring context: 2.49MB 0.0s done
#5 DONE 0.0s
#6 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#6 CACHED
#7 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#7 CACHED
#8 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#8 ERROR: "/target/launcher/linux_amd64/boot" not found: not found
------
> [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found
> Task :sdks:python:installGcpTest
Collecting oauth2client>=1.4.12 (from google-apitools<0.5.32,>=0.5.31)
Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting pyasn1-modules>=0.2.1 (from google-auth<3,>=1.18.0)
Using cached pyasn1_modules-0.3.0-py2.py3-none-any.whl (181 kB)
Collecting rsa<5,>=3.1.4 (from google-auth<3,>=1.18.0)
Using cached rsa-4.9-py3-none-any.whl (34 kB)
Collecting google-cloud-storage<3.0.0dev,>=1.32.0 (from google-cloud-aiplatform<2.0,>=1.26.0)
Using cached google_cloud_storage-2.13.0-py2.py3-none-any.whl.metadata (6.1 kB)
Collecting google-cloud-resource-manager<3.0.0dev,>=1.3.3 (from google-cloud-aiplatform<2.0,>=1.26.0)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting shapely<3.0.0dev (from google-cloud-aiplatform<2.0,>=1.26.0)
Using cached shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.0 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0 (from google-cloud-bigquery<4,>=2.0.0)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl.metadata (2.1 kB)
Collecting grpc-google-iam-v1<1.0.0dev,>=0.12.4 (from google-cloud-bigtable<3,>=2.19.0)
Using cached grpc_google_iam_v1-0.12.6-py2.py3-none-any.whl (26 kB)
Collecting grpcio-status>=1.33.2 (from google-cloud-pubsub<3,>=2.1.0)
Using cached grpcio_status-1.59.2-py3-none-any.whl.metadata (1.3 kB)
Collecting overrides<7.0.0,>=6.0.1 (from google-cloud-pubsublite<2,>=1.2.0)
Using cached overrides-6.5.0-py3-none-any.whl (17 kB)
Collecting sqlparse>=0.4.4 (from google-cloud-spanner<4,>=3.0.0)
Using cached sqlparse-0.4.4-py3-none-any.whl (41 kB)
Collecting docopt (from hdfs<3.0.0,>=2.1.0)
Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 (from httplib2<0.23.0,>=0.8)
Using cached pyparsing-3.1.1-py3-none-any.whl.metadata (5.1 kB)
Collecting attrs>=19.2.0 (from hypothesis<=7.0.0,>5.0.0)
Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis<=7.0.0,>5.0.0)
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0)
Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB)
Collecting tzlocal>=1.2 (from js2py<1,>=0.74)
Using cached tzlocal-5.2-py3-none-any.whl.metadata (7.8 kB)
Collecting pyjsparser>=2.5.1 (from js2py<1,>=0.74)
Using cached pyjsparser-2.7.1-py3-none-any.whl
Collecting importlib-resources>=1.4.0 (from jsonschema<5.0.0,>=4.0.0)
Using cached importlib_resources-6.1.0-py3-none-any.whl.metadata (4.1 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema<5.0.0,>=4.0.0)
Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl.metadata (2.8 kB)
Collecting pkgutil-resolve-name>=1.3.10 (from jsonschema<5.0.0,>=4.0.0)
Using cached pkgutil_resolve_name-1.3.10-py3-none-any.whl (4.7 kB)
Collecting referencing>=0.28.4 (from jsonschema<5.0.0,>=4.0.0)
Using cached referencing-0.30.2-py3-none-any.whl.metadata (2.6 kB)
Collecting rpds-py>=0.7.1 (from jsonschema<5.0.0,>=4.0.0)
Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.7 kB)
Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0)
Using cached dnspython-2.4.2-py3-none-any.whl.metadata (4.9 kB)
Collecting iniconfig (from pytest<8.0,>=7.1.2)
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2) (1.3.0)
Requirement already satisfied: tomli>=1.0.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2) (2.0.1)
Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0)
Using cached execnet-2.0.2-py3-none-any.whl.metadata (2.9 kB)
Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0)
Using cached charset_normalizer-3.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0)
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0)
Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB)
Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0)
Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0)
Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0)
Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3)
Using cached greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.7 kB)
Collecting docker>=4.0.0 (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB)
Collecting wrapt (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting deprecation (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0)
Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2)
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
Using cached websocket_client-1.6.4-py3-none-any.whl.metadata (7.7 kB)
Collecting google-crc32c<2.0dev,>=1.0 (from google-cloud-storage<3.0.0dev,>=1.32.0->google-cloud-aiplatform<2.0,>=1.26.0)
Using cached google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB)
Requirement already satisfied: zipp>=3.1.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from importlib-resources>=1.4.0->jsonschema<5.0.0,>=4.0.0) (3.17.0)
Collecting PyJWT<3,>=1.0.0 (from PyJWT[crypto]<3,>=1.0.0->msal<2.0.0,>=1.24.0->azure-identity<2,>=1.12.0)
Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting portalocker<3,>=1.0 (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0)
Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Collecting pyasn1>=0.1.7 (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31)
Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74)
Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB)
Using cached azure_core-1.29.5-py3-none-any.whl (192 kB)
Using cached azure_identity-1.15.0-py3-none-any.whl (164 kB)
Using cached azure_storage_blob-12.19.0b1-py3-none-any.whl (394 kB)
Using cached boto3-1.28.76-py3-none-any.whl (135 kB)
Using cached cryptography-41.0.5-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB)
Using cached fastavro-1.9.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fasteners-0.19-py3-none-any.whl (18 kB)
Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB)
Using cached google_auth-2.23.4-py2.py3-none-any.whl (183 kB)
Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Using cached google_cloud_aiplatform-1.36.0-py2.py3-none-any.whl (3.1 MB)
Using cached google_cloud_bigquery-3.13.0-py2.py3-none-any.whl (222 kB)
Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB)
Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB)
Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB)
Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB)
Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB)
Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB)
Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB)
Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB)
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 kB)
Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB)
Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB)
Using cached google_cloud_vision-3.4.5-py2.py3-none-any.whl (444 kB)
Using cached grpcio-1.59.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB)
Using cached hypothesis-6.88.1-py3-none-any.whl (421 kB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached jsonschema-4.19.2-py3-none-any.whl (83 kB)
Using cached mock-5.1.0-py3-none-any.whl (30 kB)
Using cached numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
Using cached orjson-3.9.10-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Using cached proto_plus-1.23.0rc1-py3-none-any.whl (48 kB)
Using cached protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl (311 kB)
Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Using cached pyhamcrest-2.1.0-py3-none-any.whl (54 kB)
Downloading pymongo-4.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (693 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 693.1/693.1 kB 13.9 MB/s eta 0:00:00
Using cached pytest-7.4.3-py3-none-any.whl (325 kB)
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB)
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB)
Using cached scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
Using cached SQLAlchemy-1.4.50-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached zstandard-0.22.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB)
Using cached botocore-1.31.76-py3-none-any.whl (11.3 MB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Using cached charset_normalizer-3.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (141 kB)
Using cached dnspython-2.4.2-py3-none-any.whl (300 kB)
Using cached docker-6.1.3-py3-none-any.whl (148 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached execnet-2.0.2-py3-none-any.whl (37 kB)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB)
Using cached google_cloud_storage-2.13.0-py2.py3-none-any.whl (121 kB)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB)
Using cached googleapis_common_protos-1.61.0-py2.py3-none-any.whl (230 kB)
Using cached greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (618 kB)
Using cached grpcio_status-1.59.2-py3-none-any.whl (14 kB)
Using cached importlib_resources-6.1.0-py3-none-any.whl (33 kB)
Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB)
Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB)
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Using cached referencing-0.30.2-py3-none-any.whl (25 kB)
Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB)
Using cached shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tzlocal-5.2-py3-none-any.whl (17 kB)
Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB)
Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB)
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (82 kB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (pyproject.toml): started
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.53.0.dev0-cp38-cp38-linux_x86_64.whl size=16218757 sha256=4ca8264e58fd0621eee2ccf2873ff6b869a85230bd1eb8f2a90e29d458989a49
Stored in directory: /home/jenkins/.cache/pip/wheels/c0/01/10/5a028b724cdf5b5d2643067a82afc4660de8e5639d060da291
Successfully built apache-beam
Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, threadpoolctl, tenacity, sqlparse, six, rpds-py, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, psycopg2-binary, protobuf, portalocker, pkgutil-resolve-name, parameterized, overrides, orjson, objsize, numpy, mock, joblib, jmespath, iniconfig, importlib-resources, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, backports.zoneinfo, attrs, tzlocal, sqlalchemy, shapely, scipy, rsa, requests, referencing, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, proto-plus, isodate, hypothesis, httplib2, googleapis-common-protos, google-resumable-media, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, oauth2client, jsonschema-specifications, js2py, hdfs, grpcio-status, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, jsonschema, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, msal, google-cloud-core, boto3, apache-beam, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity
Successfully installed PyJWT-2.8.0 apache-beam-2.53.0.dev0 attrs-23.1.0 azure-core-1.29.5 azure-identity-1.15.0 azure-storage-blob-12.19.0b1 backports.zoneinfo-0.2.1 boto3-1.28.76 botocore-1.31.76 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.2 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.5 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.9.0 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.4 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.36.0 google-cloud-bigquery-3.13.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.13.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.5 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.61.0 greenlet-3.0.1 grpc-google-iam-v1-0.12.6 grpcio-1.59.2 grpcio-status-1.59.2 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.88.1 idna-3.4 importlib-resources-6.1.0 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 jsonschema-4.19.2 jsonschema-specifications-2023.7.1 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.10 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 pkgutil-resolve-name-1.3.10 portalocker-2.8.2 proto-plus-1.23.0rc1 protobuf-4.24.4 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.1.0 pyjsparser-2.7.1 pymongo-4.6.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.3 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 referencing-0.30.2 regex-2023.10.3 requests-2.31.0 requests-mock-1.11.0 rpds-py-0.10.6 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.2 scipy-1.10.1 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.50 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.2 urllib3-1.26.18 websocket-client-1.6.4 wrapt-1.16.0rc1 zstandard-0.22.0
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 6m 30s
251 actionable tasks: 169 executed, 72 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/hbhhciyomky72
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4790
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4790/display/redirect?page=changes>
Changes:
[noreply] [RRIO] [Testing] Mock API integration tests (#29236)
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:11 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:12 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:13 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f01742b74c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f01742b7550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f01742b7ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fbe06efec10> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fbe06efed30> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fbe06f08280> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fbe06f08310> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fbe06f084c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fbe06f08550> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fbe06f08670> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fbe06f08700> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fbe06f08790> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fbe06f08820> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fbe06f08a60> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fbe06f08b80> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fbe06f089d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fbe06f08af0> ====================
INFO root:portable_runner.py:543 starting control server on port 45441
INFO root:portable_runner.py:543 starting data server on port 43731
INFO root:portable_runner.py:543 starting state server on port 41527
INFO root:portable_runner.py:543 starting logging server on port 36961
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbe3b75e220> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'619edeaea5602cf8dfce489ede3826c00d152d312a82e8011d28035a58f92a9c', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbe04446790> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a80995ca7556773f4ea4531a03e4749894620581d0dd1d11758abdcc5ce0e3fc', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.810363292694092 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '45003' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:45003
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:36 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:37 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:37 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:38 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:40 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:48:41 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f01742b74c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f01742b7550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f01742b7ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fbe06efec10> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fbe06efed30> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fbe06f08280> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fbe06f08310> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fbe06f084c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fbe06f08550> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fbe06f08670> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fbe06f08700> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fbe06f08790> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fbe06f08820> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fbe06f08a60> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fbe06f08b80> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fbe06f089d0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fbe06f08af0> ====================
INFO root:portable_runner.py:543 starting control server on port 36925
INFO root:portable_runner.py:543 starting data server on port 39793
INFO root:portable_runner.py:543 starting state server on port 38457
INFO root:portable_runner.py:543 starting logging server on port 35705
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbe3b692550> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3c5e28ae4247a8b802736c8fb746bd3018e0eadf053e4cf06c8bdbb4e612c7c3', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbe3b6fee80> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7c571e5a5d6a2117260e9065cc140849fe2c7447b821535bf033cab369194f01', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.824710130691528 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7225 deselected in 256.94s (0:04:16) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3746658
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3749967.
Stopping expansion service pid: 3749968.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 37s
258 actionable tasks: 182 executed, 66 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/jcckqumueolnk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4789
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4789/display/redirect>
Changes:
------------------------------------------
[...truncated 124.90 KB...]
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl.metadata (5.2 kB)
> Task :sdks:go:container:dockerPrepare
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py38:copyGolangLicenses
> Task :sdks:python:container:py38:dockerPrepare
> Task :sdks:go:container:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.4s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:a4aa0519fbd45786048bbc4daa7092fec803d22463f1cb6c4e7762dcb6a10cf0
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.24MB 0.2s done
#5 DONE 0.2s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.577 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.694 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.738 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
> Task :sdks:python:container:py38:docker FAILED
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 5.00kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.4s
#4 [internal] load build context
#4 transferring context: 2.49MB 0.0s done
#4 DONE 0.0s
#5 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#5 CACHED
#6 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#6 CACHED
#7 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#7 ERROR: "/target/launcher/linux_amd64/boot" not found: not found
#8 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:048a45a6c9b92f605d508a4b7100605cb351b3ff2ebede108dd4ade6d220f3b7
#8 resolve docker.io/library/python:3.8-bullseye@sha256:048a45a6c9b92f605d508a4b7100605cb351b3ff2ebede108dd4ade6d220f3b7 0.0s done
#8 sha256:048a45a6c9b92f605d508a4b7100605cb351b3ff2ebede108dd4ade6d220f3b7 1.86kB / 1.86kB done
#8 sha256:b9b5da1026504ee7e614c620de330cc052e234476a63ad67988229297ad680f2 7.55kB / 7.55kB done
#8 sha256:9ce34efd93772c0e6c63e119ca9c3615a22d83fbb6c32f0d32e66bc47a3a248e 2.01kB / 2.01kB done
#8 DONE 0.4s
------
> [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found
> Task :sdks:go:container:docker
#6 0.848 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 1.131 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [257 kB]
#6 1.132 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.460 Fetched 8545 kB in 2s (4345 kB/s)
#6 2.460 Reading package lists...
#6 3.141 Reading package lists...
#6 3.790 Building dependency tree...
#6 3.949 Reading state information...
#6 4.105 The following additional packages will be installed:
#6 4.105 openssl
#6 4.153 The following NEW packages will be installed:
#6 4.154 ca-certificates openssl
#6 4.239 0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
#6 4.239 Need to get 1017 kB of archives.
#6 4.239 After this operation, 1897 kB of additional disk space will be used.
#6 4.239 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 4.378 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 4.565 debconf: delaying package configuration, since apt-utils is not installed
#6 4.602 Fetched 1017 kB in 0s (4648 kB/s)
#6 4.639 Selecting previously unselected package openssl.
#6 4.639 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 4.651 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 4.656 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 4.787 Selecting previously unselected package ca-certificates.
#6 4.789 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 4.793 Unpacking ca-certificates (20210119) ...
#6 4.871 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 4.890 Setting up ca-certificates (20210119) ...
#6 5.496 Updating certificates in /etc/ssl/certs...
#6 6.226 129 added, 0 removed; done.
#6 6.275 Processing triggers for ca-certificates (20210119) ...
#6 6.284 Updating certificates in /etc/ssl/certs...
#6 6.879 0 added, 0 removed; done.
#6 6.879 Running hooks in /etc/ca-certificates/update.d...
#6 6.880 done.
#6 DONE 9.2s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.6s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.0s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.0s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.4s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:7521fe0259dcdb76c6ddcbbecb45fcf6aff4cc82c529302d723ef7a465ad042e done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s
> Task :sdks:python:installGcpTest
Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74)
Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB)
Using cached azure_core-1.29.5-py3-none-any.whl (192 kB)
Using cached azure_identity-1.15.0-py3-none-any.whl (164 kB)
Using cached azure_storage_blob-12.19.0b1-py3-none-any.whl (394 kB)
Using cached boto3-1.28.75-py3-none-any.whl (135 kB)
Using cached cryptography-41.0.5-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB)
Using cached fastavro-1.9.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fasteners-0.19-py3-none-any.whl (18 kB)
Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB)
Using cached google_auth-2.23.4-py2.py3-none-any.whl (183 kB)
Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Using cached google_cloud_aiplatform-1.36.0-py2.py3-none-any.whl (3.1 MB)
Using cached google_cloud_bigquery-3.13.0-py2.py3-none-any.whl (222 kB)
Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB)
Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB)
Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB)
Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB)
Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB)
Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB)
Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB)
Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB)
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 kB)
Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB)
Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB)
Using cached google_cloud_vision-3.4.5-py2.py3-none-any.whl (444 kB)
Using cached grpcio-1.59.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB)
Using cached hypothesis-6.88.1-py3-none-any.whl (421 kB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached jsonschema-4.19.2-py3-none-any.whl (83 kB)
Using cached mock-5.1.0-py3-none-any.whl (30 kB)
Using cached numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
Using cached orjson-3.9.10-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Using cached proto_plus-1.23.0rc1-py3-none-any.whl (48 kB)
Using cached protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl (311 kB)
Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Using cached pyhamcrest-2.1.0-py3-none-any.whl (54 kB)
Using cached pymongo-4.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (687 kB)
Using cached pytest-7.4.3-py3-none-any.whl (325 kB)
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB)
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB)
Using cached scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
Using cached SQLAlchemy-1.4.50-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached zstandard-0.22.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.4 MB)
Using cached botocore-1.31.75-py3-none-any.whl (11.3 MB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Using cached charset_normalizer-3.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (141 kB)
Using cached dnspython-2.4.2-py3-none-any.whl (300 kB)
Using cached docker-6.1.3-py3-none-any.whl (148 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached execnet-2.0.2-py3-none-any.whl (37 kB)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB)
Using cached google_cloud_storage-2.13.0-py2.py3-none-any.whl (121 kB)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB)
Using cached googleapis_common_protos-1.61.0-py2.py3-none-any.whl (230 kB)
Using cached greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (618 kB)
Using cached grpcio_status-1.59.2-py3-none-any.whl (14 kB)
Using cached importlib_resources-6.1.0-py3-none-any.whl (33 kB)
Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB)
Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB)
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Using cached referencing-0.30.2-py3-none-any.whl (25 kB)
Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB)
Using cached shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tzlocal-5.2-py3-none-any.whl (17 kB)
Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB)
Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB)
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (82 kB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (pyproject.toml): started
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): still running...
Building wheel for apache-beam (pyproject.toml): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl size=16214885 sha256=7382631bf7990908f86e9ff16f6811e058a96cd52d9adae01e0cc78718a8b6c5
Stored in directory: /home/jenkins/.cache/pip/wheels/c0/01/10/5a028b724cdf5b5d2643067a82afc4660de8e5639d060da291
Successfully built apache-beam
Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, threadpoolctl, tenacity, sqlparse, six, rpds-py, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, psycopg2-binary, protobuf, portalocker, pkgutil-resolve-name, parameterized, overrides, orjson, objsize, numpy, mock, joblib, jmespath, iniconfig, importlib-resources, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, backports.zoneinfo, attrs, tzlocal, sqlalchemy, shapely, scipy, rsa, requests, referencing, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, proto-plus, isodate, hypothesis, httplib2, googleapis-common-protos, google-resumable-media, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, oauth2client, jsonschema-specifications, js2py, hdfs, grpcio-status, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, jsonschema, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, msal, google-cloud-core, boto3, apache-beam, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity
Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0 azure-core-1.29.5 azure-identity-1.15.0 azure-storage-blob-12.19.0b1 backports.zoneinfo-0.2.1 boto3-1.28.75 botocore-1.31.75 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.2 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.5 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.9.0 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.4 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.36.0 google-cloud-bigquery-3.13.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.13.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.5 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.61.0 greenlet-3.0.1 grpc-google-iam-v1-0.12.6 grpcio-1.59.2 grpcio-status-1.59.2 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.88.1 idna-3.4 importlib-resources-6.1.0 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 jsonschema-4.19.2 jsonschema-specifications-2023.7.1 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.10 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 pkgutil-resolve-name-1.3.10 portalocker-2.8.2 proto-plus-1.23.0rc1 protobuf-4.24.4 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.1.0 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.3 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 referencing-0.30.2 regex-2023.10.3 requests-2.31.0 requests-mock-1.11.0 rpds-py-0.10.6 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.2 scipy-1.10.1 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.50 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.2 urllib3-1.26.18 websocket-client-1.6.4 wrapt-1.16.0rc1 zstandard-0.22.0
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 6m 28s
251 actionable tasks: 164 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/hvg7nhub54qjk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4788
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4788/display/redirect>
Changes:
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:36:38 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:36:38 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6d597a91f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6d597a9280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6d597a99d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f40affc4940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f40affc4a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f40affc4f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f40affc2040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f40affc21f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f40affc2280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f40affc23a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f40affc2430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f40affc24c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f40affc2550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f40affc2790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f40affc28b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f40affc2700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f40affc2820> ====================
INFO root:portable_runner.py:543 starting control server on port 35671
INFO root:portable_runner.py:543 starting data server on port 32797
INFO root:portable_runner.py:543 starting state server on port 46525
INFO root:portable_runner.py:543 starting logging server on port 46123
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f40e4590250> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cb99a3e31ad6540b23353d8e099edb367e99420143016448b5da7d3a1f208101', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f40e48e7ee0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'00cf434b64bd4724684a43952a2abf9d3054f160622c399a559aed7b6d6f7aa7', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 13.738547801971436 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '37359' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:37359
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:37:04 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:37:07 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 01, 2023 5:37:09 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6d597a91f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6d597a9280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6d597a99d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f40affc4940> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f40affc4a60> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f40affc4f70> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f40affc2040> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f40affc21f0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f40affc2280> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f40affc23a0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f40affc2430> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f40affc24c0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f40affc2550> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f40affc2790> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f40affc28b0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f40affc2700> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f40affc2820> ====================
INFO root:portable_runner.py:543 starting control server on port 38313
INFO root:portable_runner.py:543 starting data server on port 44219
INFO root:portable_runner.py:543 starting state server on port 45777
INFO root:portable_runner.py:543 starting logging server on port 44417
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f40ac5d7220> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f7ad46bf477c1c3d6be9cb9578b209732bda036f1b92cbe05e207d80685434e9', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f40e48c3460> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'dd0ea7495c5f24240b41988cfa1c4de8cd3f6b45074e598e7323a47a57c90a40', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.634660243988037 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7220 deselected in 256.02s (0:04:16) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1767115
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1767688.
Stopping expansion service pid: 1767689.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 7s
258 actionable tasks: 173 executed, 75 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/dztdvzycm6qre
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4787
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4787/display/redirect>
Changes:
------------------------------------------
[...truncated 919.22 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:35:41 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:35:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:35:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:35:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:35:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:35:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f931f11cee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f931f11cf70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f931f11e700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f70e6edd670> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f70e6edd790> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f70e6eddca0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f70e6eddd30> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f70e6eddee0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f70e6eddf70> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f70e6edc0d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f70e6edc160> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f70e6edc1f0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f70e6edc280> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f70e6edc4c0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f70e6edc5e0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f70e6edc430> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f70e6edc550> ====================
INFO root:portable_runner.py:543 starting control server on port 46281
INFO root:portable_runner.py:543 starting data server on port 45939
INFO root:portable_runner.py:543 starting state server on port 45561
INFO root:portable_runner.py:543 starting logging server on port 34181
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f711ad05e50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cb125acafbd8a253e5bda00a3ade9cee3b17c212936a5065a5f3852f8bad1d9f', worker_id = worker_60
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f711ad19130> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b97c88c72d23259790c588e3d15e2761bdd67569ab1d32f2ed4a368aa8004a3a', worker_id = worker_61
INFO root:portable_runner.py:543 Completed job in 13.768619060516357 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '34461' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:34461
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:36:06 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:36:07 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:36:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:36:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:36:09 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:36:11 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f931f11cee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f931f11cf70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f931f11e700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f70e6edd670> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f70e6edd790> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f70e6eddca0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f70e6eddd30> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f70e6eddee0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f70e6eddf70> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f70e6edc0d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f70e6edc160> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f70e6edc1f0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f70e6edc280> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f70e6edc4c0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f70e6edc5e0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f70e6edc430> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f70e6edc550> ====================
INFO root:portable_runner.py:543 starting control server on port 35579
INFO root:portable_runner.py:543 starting data server on port 44937
INFO root:portable_runner.py:543 starting state server on port 43625
INFO root:portable_runner.py:543 starting logging server on port 37973
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f711ac96df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'1616c6642fc485c0f434ea19411fe8ec366e77e781a847247adc5b49ad6065f4', worker_id = worker_62
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f711ad0ff70> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3ecf83b182b7b1db4aaa8a30ad876b3c6852fa4b69d21b2ee6a66c66ced45af1', worker_id = worker_63
INFO root:portable_runner.py:543 Completed job in 15.68571424484253 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7220 deselected in 259.79s (0:04:19) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 356605
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 360673.
Stopping expansion service pid: 360674.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:extensions:schemaio-expansion-service:analyzeClassesDependencies'.
> Dependency analysis found issues.
unusedDeclaredArtifacts
- com.microsoft.sqlserver:mssql-jdbc:12.2.0.jre11@jar
- com.oracle.database.jdbc:ojdbc8:23.2.0.0@jar
- mysql:mysql-connector-java:8.0.22@jar
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 15s
257 actionable tasks: 180 executed, 67 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/n5sevn5w6tzcc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4786
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4786/display/redirect>
Changes:
------------------------------------------
[...truncated 259.04 KB...]
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.1s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.0s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.3s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.2s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.6s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.3s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.3s done
#21 writing image sha256:8bee004fe541e90da232ad5c974bf3f42a0eaffaf9295c719fddfdf39de79fc0 done
#21 naming to docker.io/apache/beam_java8_sdk:2.52.0.dev done
#21 DONE 0.3s
> Task :release:go-licenses:py:dockerRun
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/grpc v1.58.1
go: downloading google.golang.org/protobuf v1.31.0
go: downloading golang.org/x/net v0.15.0
go: downloading golang.org/x/sys v0.12.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230913181813-007df8e322eb
go: downloading google.golang.org/genproto v0.0.0-20230821184602-ccc8af3d0e93
go: downloading golang.org/x/text v0.13.0
go: added github.com/apache/beam/sdks/v2 v2.51.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.15.0
go: added golang.org/x/sys v0.12.0
go: added golang.org/x/text v0.13.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230913181813-007df8e322eb
go: added google.golang.org/grpc v1.58.1
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/python/container --save_path=/output/licenses
W1031 17:12:16.158382 36 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.12.0/unix/asm_linux_amd64.s
> Task :sdks:go:container:docker
#6 1.861 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 2.314 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [256 kB]
#6 2.330 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 4.798 Fetched 8544 kB in 4s (2331 kB/s)
#6 4.798 Reading package lists...
#6 5.614 Reading package lists...
#6 6.403 Building dependency tree...
#6 6.612 Reading state information...
#6 6.842 The following additional packages will be installed:
#6 6.842 openssl
#6 6.895 The following NEW packages will be installed:
#6 6.896 ca-certificates openssl
#6 6.992 0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
#6 6.992 Need to get 1017 kB of archives.
#6 6.992 After this operation, 1897 kB of additional disk space will be used.
#6 6.992 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 7.211 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 7.497 debconf: delaying package configuration, since apt-utils is not installed
#6 7.546 Fetched 1017 kB in 0s (3408 kB/s)
#6 7.576 Selecting previously unselected package openssl.
#6 7.576 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 7.588 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 7.592 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 7.902 Selecting previously unselected package ca-certificates.
#6 7.904 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 7.909 Unpacking ca-certificates (20210119) ...
#6 8.172 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 8.209 Setting up ca-certificates (20210119) ...
#6 9.053 Updating certificates in /etc/ssl/certs...
#6 9.868 129 added, 0 removed; done.
#6 9.919 Processing triggers for ca-certificates (20210119) ...
#6 9.930 Updating certificates in /etc/ssl/certs...
#6 10.56 0 added, 0 removed; done.
#6 10.56 Running hooks in /etc/ca-certificates/update.d...
#6 10.59 done.
#6 DONE 11.8s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.2s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.0s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.0s
#11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.4s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:092f30f553a99daf9fd5045a2d327d56aa3f8cf7f69693fef955f26d5046801d done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s
> Task :release:go-licenses:py:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/v2/python/container
+ tee /output/licenses/list.csv
W1031 17:12:21.605648 80 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.12.0/unix/asm_linux_amd64.s
> Task :sdks:python:installGcpTest
> Task :release:go-licenses:py:dockerRun
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py38:copyGolangLicenses
> Task :sdks:python:container:py38:dockerPrepare
> Task :sdks:python:container:py38:docker FAILED
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 5.00kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.3s
#4 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:5598a0361e5a1e6fc0bcf942208ac47bf17b1865ea7767c2f1e6d572f7917736
#4 CACHED
#5 [internal] load build context
#5 transferring context: 2.49MB 0.1s done
#5 DONE 0.1s
#6 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#6 CACHED
#7 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#7 ERROR: "/target/launcher/linux_amd64/boot" not found: not found
#8 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#8 CANCELED
------
> [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found
> Task :sdks:java:io:google-cloud-platform:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:google-cloud-platform:classes
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:io:google-cloud-platform:expansion-service:compileJava NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:jar
> Task :sdks:java:io:google-cloud-platform:expansion-service:startScripts
> Task :sdks:java:io:google-cloud-platform:expansion-service:distTar
> Task :sdks:java:io:google-cloud-platform:expansion-service:distZip
> Task :sdks:java:io:google-cloud-platform:expansion-service:compileTestJava NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:testClasses UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:packageTests
> Task :sdks:java:extensions:sql:compileJava
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar
> Task :sdks:java:extensions:sql:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:extensions:sql:classes
> Task :sdks:java:extensions:sql:jar
> Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:zetasql:jar
> Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip
> Task :sdks:java:io:google-cloud-platform:expansion-service:assemble
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check
> Task :sdks:java:io:google-cloud-platform:expansion-service:build
> Task :sdks:java:extensions:sql:expansion-service:shadowJar
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 7m 2s
251 actionable tasks: 175 executed, 66 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/c2funrn7ldgea
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4785
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4785/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:38:43 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:38:43 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:38:43 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:38:45 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:38:45 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:38:45 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb11636eee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb11636ef70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb116371700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f632e16d670> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f632e16d790> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f632e16dca0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f632e16dd30> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f632e16dee0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f632e16df70> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f632e16e0d0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f632e16e160> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f632e16e1f0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f632e16e280> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f632e16e4c0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f632e16e5e0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f632e16e430> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f632e16e550> ====================
INFO root:portable_runner.py:542 starting control server on port 38105
INFO root:portable_runner.py:542 starting data server on port 33231
INFO root:portable_runner.py:542 starting state server on port 44605
INFO root:portable_runner.py:542 starting logging server on port 37693
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f63623c0550> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'57714795eba475058a40502fa80ad0d8b036284ea543f48e39e4b683e6a8708e', worker_id = worker_85
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6362a186d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'39d2e40aae3e74a27fa6c5fb01d18c69e9be146ce953ebeffec137e962c58b64', worker_id = worker_86
INFO root:portable_runner.py:542 Completed job in 15.884521007537842 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '34439' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:34439
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:39:10 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:39:11 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:39:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:39:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:39:14 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 11:39:15 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb11636eee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb11636ef70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb116371700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f632e16d670> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f632e16d790> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f632e16dca0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f632e16dd30> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f632e16dee0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f632e16df70> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f632e16e0d0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f632e16e160> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f632e16e1f0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f632e16e280> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f632e16e4c0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f632e16e5e0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f632e16e430> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f632e16e550> ====================
INFO root:portable_runner.py:542 starting control server on port 40199
INFO root:portable_runner.py:542 starting data server on port 35693
INFO root:portable_runner.py:542 starting state server on port 42285
INFO root:portable_runner.py:542 starting logging server on port 37401
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f635ca87880> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'2fca9ed10e4e4cee1cb265316edbbadd0b0ae1650bf88fad769b5ba1eefe1e4d', worker_id = worker_87
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6362306640> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'fafa49e5f680187ed3ce4cecd948dce99191f57678979498f30e2ac354b7b52b', worker_id = worker_88
INFO root:portable_runner.py:542 Completed job in 16.088260412216187 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7218 deselected in 269.57s (0:04:29) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3864059
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3864585.
Stopping expansion service pid: 3864586.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 18s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/4bc7a6xd277ww
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4784
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4784/display/redirect>
Changes:
------------------------------------------
[...truncated 1.56 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:01 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:01 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:02 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:03 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:03 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:04 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe425d6fee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe425d6ff70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe425d73700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7facf2054670> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7facf2054790> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7facf2054ca0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7facf2054d30> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7facf2054ee0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7facf2054f70> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7facf205b0d0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7facf205b160> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7facf205b1f0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7facf205b280> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7facf205b4c0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7facf205b5e0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7facf205b430> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7facf205b550> ====================
INFO root:portable_runner.py:542 starting control server on port 39953
INFO root:portable_runner.py:542 starting data server on port 33113
INFO root:portable_runner.py:542 starting state server on port 45143
INFO root:portable_runner.py:542 starting logging server on port 33931
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fad254d6d00> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'5462dbd959764105c94a8ace465de91811e2c09d1f74a8e30bea71bd7d3e2f84', worker_id = worker_85
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fad2681cf40> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'c0bbabb0089259ddb7958075d906a3c6cb4f1906245b3094a89f201cf68334f5', worker_id = worker_86
INFO root:portable_runner.py:542 Completed job in 13.40477442741394 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '60755' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:60755
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:26 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:27 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:27 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:27 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:29 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 5:46:31 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe425d6fee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe425d6ff70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe425d73700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7facf2054670> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7facf2054790> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7facf2054ca0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7facf2054d30> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7facf2054ee0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7facf2054f70> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7facf205b0d0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7facf205b160> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7facf205b1f0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7facf205b280> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7facf205b4c0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7facf205b5e0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7facf205b430> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7facf205b550> ====================
INFO root:portable_runner.py:542 starting control server on port 45133
INFO root:portable_runner.py:542 starting data server on port 42589
INFO root:portable_runner.py:542 starting state server on port 35701
INFO root:portable_runner.py:542 starting logging server on port 36807
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fad254ca880> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'd8ef639341fcbcb40607a1c0f0766d9bed4cca846c79126dcb9bb12933ebef46', worker_id = worker_87
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fad25449a90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'986c11120134665056d617478d2668105c9af8cc684d4b63f381a16c9b4bcd61', worker_id = worker_88
INFO root:portable_runner.py:542 Completed job in 15.75563931465149 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7218 deselected in 254.14s (0:04:14) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1255294
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1255858.
Stopping expansion service pid: 1255859.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 36m 35s
258 actionable tasks: 173 executed, 75 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/2c2mccull2xkk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4783
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4783/display/redirect>
Changes:
------------------------------------------
[...truncated 2.35 MB...]
> with TestPipeline() as p:
apache_beam/transforms/sql_test.py:163:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:608: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:575: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:581: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py:541: in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exc...127.0.0.1:32913 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-10-31T00:18:38.63207099+00:00"}"
>
def _next(self) -> Any:
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(
self._state, self._response_deserializer
)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler,
)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return self._state.response is not None or (
cygrpc.OperationType.receive_message not in self._state.due
and self._state.code is not None
)
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:32913 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-10-31T00:18:38.63207099+00:00"}"
E >
../../build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py:967: _MultiThreadedRendezvous
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '55297' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:55297
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:27 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:28 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:28 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:29 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:31 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:31 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Oct 31, 2023 12:17:31 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.11_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f4543ad0b80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f4543ad0c20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f4543ad1440> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f65f4a971a0> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f65f4a972e0> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f65f4a97880> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f65f4a97920> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f65f4a97b00> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f65f4a97ba0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f65f4a97ce0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f65f4a97d80> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f65f4a97e20> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f65f4a97ec0> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f65f4a98180> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f65f4a982c0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f65f4a980e0> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f65f4a98220> ====================
INFO root:portable_runner.py:542 starting control server on port 43309
INFO root:portable_runner.py:542 starting data server on port 42479
INFO root:portable_runner.py:542 starting state server on port 46457
INFO root:portable_runner.py:542 starting logging server on port 46103
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f65f050f150> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.11_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.11_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'1b701512f3b6f585fa7c8d0aac6a1a473f3778e1a62b3c66a320f24c50c54c32', worker_id = worker_60
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f65f0654b10> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'a95d92eabd884cb035c595d9ff142df2763681fb777a3f30d7fa4b8a6949ad57', worker_id = worker_61
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 540, in read_messages
for message in self._message_stream:
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py",> line 541, in __next__
return self._next()
^^^^^^^^^^^^
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py",> line 967, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:32913 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-10-31T00:18:38.633035354+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:32913 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-10-31T00:18:38.63207099+00:00"}"
>
= 1 failed, 8 passed, 18 skipped, 7202 deselected, 2 warnings in 373.81s (0:06:13) =
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 459873
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 460378.
Stopping expansion service pid: 460379.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 33m 22s
165 actionable tasks: 26 executed, 139 up-to-date
Publishing build scan...
https://ge.apache.org/s/drst7l2owbkdk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4782
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4782/display/redirect?page=changes>
Changes:
[noreply] Remove anonymous function from fileio.ReadMatches example (#29186)
------------------------------------------
[...truncated 1.49 MB...]
component_coder_ids: "HzfssDzMzQTimestampedValueCoder"
>
>
coders: <
key: "HzfssDzMzQKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "HzfssDzMzQVarIntCoder"
component_coder_ids: "HzfssDzMzQIterableCoder"
>
>
coders: <
key: "HzfssDzMzQRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$c63aac60-d584-4df6-a5b7-b63de7667840"
>
>
>
coders: <
key: "HzfssDzMzQTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000H\016S\211sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\202l\223\321v\310\023n\221\251`\n)\321A.\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "HzfssDzMzQVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "HzfssDzMzQVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "HzfssDzMzQbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.52.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.52.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT-3Hap7GUuxBoD2VJsbE-2JP7uYgrp_wxB3q9CsBmKjv0.jar\022@dc76a9ec652ec41a03d9526c6c4fb624feee620ae9ff0c41deaf42b0198a8efd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT-3Hap7GUuxBoD2VJsbE-2JP7uYgrp_wxB3q9CsBmKjv0.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.52.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/10/30 17:21:55 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1698686515227450638
2023/10/30 17:21:57 Prepared job with id: go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595 and staging token: go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595
2023/10/30 17:21:58 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595
2023/10/30 17:21:58 Submitted job: go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595
2023/10/30 17:21:58 Job[go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595] state: STOPPED
2023/10/30 17:21:58 Job[go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595] state: STARTING
2023/10/30 17:21:58 Job[go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595] state: RUNNING
2023/10/30 17:21:58 2023-10-30 17:21:58. (1): ==================== <function annotate_downstream_side_inputs at 0x7fbc57457040> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fbc57457160> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (3): ==================== <function pack_combiners at 0x7fbc57457670> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (4): ==================== <function lift_combiners at 0x7fbc57457700> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (5): ==================== <function expand_sdf at 0x7fbc574578b0> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (6): ==================== <function expand_gbk at 0x7fbc57457940> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (7): ==================== <function sink_flattens at 0x7fbc57457a60> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (8): ==================== <function greedily_fuse at 0x7fbc57457af0> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (9): ==================== <function read_to_impulse at 0x7fbc57457b80> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (10): ==================== <function impulse_to_input at 0x7fbc57457c10> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (11): ==================== <function sort_stages at 0x7fbc57457e50> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fbc57457f70> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (13): ==================== <function setup_timer_mapping at 0x7fbc57457dc0> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (14): ==================== <function populate_data_channel_coders at 0x7fbc57457ee0> ====================
2023/10/30 17:21:58 2023-10-30 17:21:58. (15): starting control server on port 38277
2023/10/30 17:21:58 2023-10-30 17:21:58. (16): starting data server on port 37739
2023/10/30 17:21:58 2023-10-30 17:21:58. (17): starting state server on port 46049
2023/10/30 17:21:58 2023-10-30 17:21:58. (18): starting logging server on port 39359
2023/10/30 17:21:58 2023-10-30 17:21:58. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc5423daf0> for environment HzfssDzMzQbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
2023/10/30 17:21:58 2023-10-30 17:21:58. (20): Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
2023/10/30 17:21:58 2023-10-30 17:21:58. (21): Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
2023/10/30 17:22:04 2023-10-30 17:22:04. (22): Waiting for docker to start up. Current status is running
2023/10/30 17:22:04 2023-10-30 17:22:04. (23): Docker container is running. container_id = b'e4a85b12e319c68923547162d005787c578abab075e66c5bd04f73343b301718', worker_id = worker_14
2023/10/30 17:22:05 2023-10-30 17:22:05. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc8b575b20> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/10/30 17:22:08 2023-10-30 17:22:07. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/10/30 17:22:08 2023-10-30 17:22:08. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/10/30 17:22:09 2023-10-30 17:22:09. (27): Waiting for docker to start up. Current status is running
2023/10/30 17:22:09 2023-10-30 17:22:09. (28): Docker container is running. container_id = b'ebace8a81fe8d2f1bfe4a23e111cd1655bd9d858e7d22f7580450ea7c11572a1', worker_id = worker_16
2023/10/30 17:22:14 2023-10-30 17:22:14. (29): Completed job in 16.614839553833008 seconds with state DONE.
2023/10/30 17:22:14 Job[go-testjdbcio_postgresreadwrite-920-0b00d4c3-e95d-4f9b-86b7-5170e35e3595] state: DONE
2023/10/30 17:22:14 🐳 Terminating container: 490af5eba09b
2023/10/30 17:22:15 🚫 Container terminated: 490af5eba09b
--- PASS: TestJDBCIO_PostgresReadWrite (45.17s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 110.133s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.035s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36551
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpgy_pi4k2/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42777
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 59s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/e62o3eejqueta
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4781
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4781/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
component_coder_ids: "KqXyoruSMnTimestampedValueCoder"
>
>
coders: <
key: "KqXyoruSMnKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "KqXyoruSMnVarIntCoder"
component_coder_ids: "KqXyoruSMnIterableCoder"
>
>
coders: <
key: "KqXyoruSMnRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$0b1a4724-48ee-4de9-bcec-24f8b77a14e5"
>
>
>
coders: <
key: "KqXyoruSMnTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\214\002\322@sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\253\033\205Z\014\243\365\221\276\203\317\313\207\034@\303\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "KqXyoruSMnVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "KqXyoruSMnVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "KqXyoruSMnbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.52.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.52.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT-3Hap7GUuxBoD2VJsbE-2JP7uYgrp_wxB3q9CsBmKjv0.jar\022@dc76a9ec652ec41a03d9526c6c4fb624feee620ae9ff0c41deaf42b0198a8efd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT-3Hap7GUuxBoD2VJsbE-2JP7uYgrp_wxB3q9CsBmKjv0.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.52.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/10/30 11:21:33 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1698664893934638206
2023/10/30 11:21:38 Prepared job with id: go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce and staging token: go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce
2023/10/30 11:21:39 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce
2023/10/30 11:21:39 Submitted job: go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce
2023/10/30 11:21:39 2023-10-30 11:21:39. (1): ==================== <function annotate_downstream_side_inputs at 0x7f6ad9fbd040> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f6ad9fbd160> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (3): ==================== <function pack_combiners at 0x7f6ad9fbd670> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (4): ==================== <function lift_combiners at 0x7f6ad9fbd700> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (5): ==================== <function expand_sdf at 0x7f6ad9fbd8b0> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (6): ==================== <function expand_gbk at 0x7f6ad9fbd940> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (7): ==================== <function sink_flattens at 0x7f6ad9fbda60> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (8): ==================== <function greedily_fuse at 0x7f6ad9fbdaf0> ====================
2023/10/30 11:21:39 Job[go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce] state: STOPPED
2023/10/30 11:21:39 Job[go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce] state: STARTING
2023/10/30 11:21:39 Job[go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce] state: RUNNING
2023/10/30 11:21:39 2023-10-30 11:21:39. (9): ==================== <function read_to_impulse at 0x7f6ad9fbdb80> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (10): ==================== <function impulse_to_input at 0x7f6ad9fbdc10> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (11): ==================== <function sort_stages at 0x7f6ad9fbde50> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f6ad9fbdf70> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (13): ==================== <function setup_timer_mapping at 0x7f6ad9fbddc0> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (14): ==================== <function populate_data_channel_coders at 0x7f6ad9fbdee0> ====================
2023/10/30 11:21:39 2023-10-30 11:21:39. (15): starting control server on port 42499
2023/10/30 11:21:39 2023-10-30 11:21:39. (16): starting data server on port 42017
2023/10/30 11:21:39 2023-10-30 11:21:39. (17): starting state server on port 44303
2023/10/30 11:21:39 2023-10-30 11:21:39. (18): starting logging server on port 36949
2023/10/30 11:21:39 2023-10-30 11:21:39. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6b0b878850> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/10/30 11:21:41 2023-10-30 11:21:40. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/10/30 11:21:41 2023-10-30 11:21:41. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/10/30 11:21:43 2023-10-30 11:21:43. (22): Waiting for docker to start up. Current status is running
2023/10/30 11:21:43 2023-10-30 11:21:43. (23): Docker container is running. container_id = b'57b626426f6d53e15eb16ffda8b7982cff5f3148ee5a9375965c8a58a4ddbb37', worker_id = worker_15
2023/10/30 11:21:44 2023-10-30 11:21:44. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6b0b83d970> for environment KqXyoruSMnbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
2023/10/30 11:21:47 2023-10-30 11:21:47. (25): Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
2023/10/30 11:21:47 2023-10-30 11:21:47. (26): Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
2023/10/30 11:21:49 2023-10-30 11:21:49. (27): Waiting for docker to start up. Current status is running
2023/10/30 11:21:49 2023-10-30 11:21:49. (28): Docker container is running. container_id = b'dbe9ccfd8430444182f4a1559a765c3c3df287bb405d530d81365f301be9e91a', worker_id = worker_17
2023/10/30 11:21:57 2023-10-30 11:21:57. (29): Completed job in 18.381914615631104 seconds with state DONE.
2023/10/30 11:21:57 Job[go-testjdbcio_postgresreadwrite-709-50b1479a-5921-4156-b064-69802ad754ce] state: DONE
2023/10/30 11:21:57 🐳 Terminating container: 9f17fed7c13a
2023/10/30 11:21:58 🚫 Container terminated: 9f17fed7c13a
--- PASS: TestJDBCIO_PostgresReadWrite (51.27s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 127.827s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.044s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 45389
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp3s_x3_p9/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0" for Docker environment
INFO:__main__:Listening for expansion requests at 41007
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 46s
258 actionable tasks: 171 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ihtrhxshlw26a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4780
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4780/display/redirect>
Changes:
------------------------------------------
[...truncated 122.11 KB...]
go: downloading google.golang.org/genproto v0.0.0-20230821184602-ccc8af3d0e93
go: downloading golang.org/x/text v0.13.0
go: added github.com/apache/beam/sdks/v2 v2.51.0
go: added github.com/golang/protobuf v1.5.3
go: added golang.org/x/net v0.15.0
go: added golang.org/x/sys v0.12.0
go: added golang.org/x/text v0.13.0
go: added google.golang.org/genproto/googleapis/rpc v0.0.0-20230913181813-007df8e322eb
go: added google.golang.org/grpc v1.58.1
go: added google.golang.org/protobuf v1.31.0
+ go-licenses save github.com/apache/beam/sdks/v2/python/container --save_path=/output/licenses
> Task :sdks:go:container:dockerPrepare
> Task :sdks:python:installGcpTest
Collecting cryptography>=41.0.2
Using cached cryptography-41.0.5-cp37-abi3-manylinux_2_28_x86_64.whl.metadata (5.2 kB)
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.59kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:5840452260db162c2dd31033cb55575745861634b1be75a1d8cff559b6c8b942
#4 resolve docker.io/library/eclipse-temurin:8@sha256:5840452260db162c2dd31033cb55575745861634b1be75a1d8cff559b6c8b942 0.0s done
#4 CACHED
#5 [internal] load build context
#5 transferring context: 51.03MB 0.5s done
#5 DONE 0.5s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 4.9s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.6s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.4s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.2s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.3s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.4s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 1.1s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.3s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.3s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.7s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.4s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.2s done
#21 writing image sha256:2053525c7fd4449d912bf365f49eabd5d5ecf4623991feac2a258a70e7fe83e4 done
#21 naming to docker.io/apache/beam_java8_sdk:2.52.0.dev done
#21 DONE 0.2s
> Task :release:go-licenses:py:dockerRun
W1030 05:11:58.841305 38 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.12.0/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/python/container
+ tee /output/licenses/list.csv
W1030 05:12:03.327407 82 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.12.0/unix/asm_linux_amd64.s
+ chmod -R a+w /output/licenses
> Task :sdks:go:container:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.3s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:c141beaa9e0767774221cc82efe3a6712a1cc4f75d2699334dfd9a28a6f7357b
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.24MB 0.2s done
#5 DONE 0.2s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.484 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.582 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.619 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 1.017 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 1.291 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [256 kB]
#6 1.325 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.627 Fetched 8544 kB in 2s (3862 kB/s)
#6 2.627 Reading package lists...
#6 3.323 Reading package lists...
#6 4.005 Building dependency tree...
#6 4.195 Reading state information...
#6 4.367 The following additional packages will be installed:
#6 4.367 openssl
#6 4.415 The following NEW packages will be installed:
#6 4.417 ca-certificates openssl
#6 4.489 0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
#6 4.489 Need to get 1017 kB of archives.
#6 4.489 After this operation, 1897 kB of additional disk space will be used.
#6 4.489 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 4.627 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 4.809 debconf: delaying package configuration, since apt-utils is not installed
#6 4.840 Fetched 1017 kB in 0s (4944 kB/s)
#6 4.866 Selecting previously unselected package openssl.
#6 4.866 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 4.881 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 4.886 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 5.008 Selecting previously unselected package ca-certificates.
#6 5.012 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 5.014 Unpacking ca-certificates (20210119) ...
#6 5.080 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 5.097 Setting up ca-certificates (20210119) ...
#6 5.686 Updating certificates in /etc/ssl/certs...
#6 6.396 129 added, 0 removed; done.
#6 6.442 Processing triggers for ca-certificates (20210119) ...
#6 6.451 Updating certificates in /etc/ssl/certs...
#6 7.006 0 added, 0 removed; done.
#6 7.006 Running hooks in /etc/ca-certificates/update.d...
#6 7.007 done.
#6 DONE 7.5s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.3s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.3s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:caa8e67a55c8e153625657706cf4806862322622b59352a1fc44b5aefab73e59 done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py38:copyGolangLicenses
> Task :sdks:python:container:py38:dockerPrepare
> Task :sdks:python:container:py38:docker FAILED
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 5.00kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.3s
#4 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:5598a0361e5a1e6fc0bcf942208ac47bf17b1865ea7767c2f1e6d572f7917736
#4 CACHED
#5 [internal] load build context
#5 transferring context: 2.49MB 0.0s done
#5 DONE 0.0s
#6 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#6 CACHED
#7 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#7 ERROR: "/target/launcher/linux_amd64/boot" not found: not found
#8 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#8 CANCELED
------
> [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
Waiting for server to start up...
Server started at port 42951
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 802790
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 6m 4s
251 actionable tasks: 164 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/rxvzoqu5w7nc2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org