You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/11/21 05:37:16 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4846
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4846/display/redirect>
Changes:
------------------------------------------
[...truncated 1.60 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:17 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:18 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:18 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb425d163a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb425d16430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb425d16b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8f03c9af70> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8f03c9b0d0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8f03c9b5e0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8f03c9b670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8f03c9b820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8f03c9b8b0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8f03c9b9d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8f03c9ba60> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8f03c9baf0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8f03c9bb80> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8f03c9bdc0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8f03c9bee0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8f03c9bd30> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8f03c9be50> ====================
INFO root:portable_runner.py:543 starting control server on port 33941
INFO root:portable_runner.py:543 starting data server on port 34281
INFO root:portable_runner.py:543 starting state server on port 33161
INFO root:portable_runner.py:543 starting logging server on port 41101
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f37002e80> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'64e4347247a7a7a6129e8f1b8bab51273b4aab9aefaf7c4a7c494a4f8882c864', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f370e2dc0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'427fef64563fe0dc2e2b432326832f7038b03e123f2d39c931ff05a6625875ac', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.83739447593689 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '60201' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:60201
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:43 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:44 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:47 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 5:36:48 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb425d163a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb425d16430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb425d16b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8f03c9af70> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8f03c9b0d0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8f03c9b5e0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8f03c9b670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8f03c9b820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8f03c9b8b0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8f03c9b9d0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8f03c9ba60> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8f03c9baf0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8f03c9bb80> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8f03c9bdc0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8f03c9bee0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8f03c9bd30> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8f03c9be50> ====================
INFO root:portable_runner.py:543 starting control server on port 46505
INFO root:portable_runner.py:543 starting data server on port 33589
INFO root:portable_runner.py:543 starting state server on port 40537
INFO root:portable_runner.py:543 starting logging server on port 35133
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f370a5c70> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c58a1e4f7db05cb739f62fcfb14d88883f477eb4aca4ed86550ca561aee53541', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8f37028820> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4f553941a7f10737ca5633657b4756ee867a2821d5e6a04533d650d7b137976a', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.574182748794556 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7211 deselected in 253.36s (0:04:13) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 832206
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 833495.
Stopping expansion service pid: 833496.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 50s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/6jarvinw6nguk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #4881
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4881/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4880
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4880/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.25.1 to 1.25.8 in /sdks
------------------------------------------
[...truncated 1.50 MB...]
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "UCPxlkhQgvVarIntCoder"
component_coder_ids: "UCPxlkhQgvTimestampedValueCoder"
>
>
coders: <
key: "UCPxlkhQgvKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "UCPxlkhQgvVarIntCoder"
component_coder_ids: "UCPxlkhQgvIterableCoder"
>
>
coders: <
key: "UCPxlkhQgvRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$cd4a8f0d-5f0a-40d4-a435-6e0bfefc1326"
>
>
>
coders: <
key: "UCPxlkhQgvTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000A\032\270\034sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\246-\033F\027\205!8\217\246\240\251QzK\203\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "UCPxlkhQgvVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "UCPxlkhQgvVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "UCPxlkhQgvbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar\022@18badfe2da8bfc1469b801517feb8f4a1d0ffcdc09b98761b389b6d6b58b6af5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/29 17:21:56 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701278516290052048
2023/11/29 17:21:58 Prepared job with id: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2 and staging token: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2
2023/11/29 17:21:59 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2
2023/11/29 17:21:59 Submitted job: go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2
2023/11/29 17:21:59 2023-11-29 17:21:59. (5): ==================== <function expand_sdf at 0x7fe04a6a69d0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (6): ==================== <function expand_gbk at 0x7fe04a6a6a60> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (7): ==================== <function sink_flattens at 0x7fe04a6a6b80> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (8): ==================== <function greedily_fuse at 0x7fe04a6a6c10> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (9): ==================== <function read_to_impulse at 0x7fe04a6a6ca0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (10): ==================== <function impulse_to_input at 0x7fe04a6a6d30> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (11): ==================== <function sort_stages at 0x7fe04a6a6f70> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fe04a6a70d0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (13): ==================== <function setup_timer_mapping at 0x7fe04a6a6ee0> ====================
2023/11/29 17:21:59 2023-11-29 17:21:59. (14): ==================== <function populate_data_channel_coders at 0x7fe04a6a7040> ====================
2023/11/29 17:21:59 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: STOPPED
2023/11/29 17:21:59 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: STARTING
2023/11/29 17:21:59 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: RUNNING
2023/11/29 17:21:59 2023-11-29 17:21:59. (15): starting control server on port 40565
2023/11/29 17:21:59 2023-11-29 17:21:59. (16): starting data server on port 45309
2023/11/29 17:21:59 2023-11-29 17:21:59. (17): starting state server on port 42419
2023/11/29 17:21:59 2023-11-29 17:21:59. (18): starting logging server on port 34509
2023/11/29 17:21:59 2023-11-29 17:21:59. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe07f05ed00> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/29 17:22:02 2023-11-29 17:22:02. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/29 17:22:03 2023-11-29 17:22:03. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/29 17:22:04 2023-11-29 17:22:04. (22): Waiting for docker to start up. Current status is running
2023/11/29 17:22:04 2023-11-29 17:22:04. (23): Docker container is running. container_id = b'30b9e64c7e5f6d385241bee0e6759c8144951141000721d127ab589177c79004', worker_id = worker_17
2023/11/29 17:22:05 2023-11-29 17:22:05. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe07e5e04c0> for environment UCPxlkhQgvbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/29 17:22:08 2023-11-29 17:22:08. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/29 17:22:08 2023-11-29 17:22:08. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/29 17:22:09 2023-11-29 17:22:09. (27): Waiting for docker to start up. Current status is running
2023/11/29 17:22:09 2023-11-29 17:22:09. (28): Docker container is running. container_id = b'5a16f4afe6628dbbaacc47619addcc3a0b08e369928d00c209aac6acc7ae4288', worker_id = worker_19
2023/11/29 17:22:16 2023-11-29 17:22:16. (29): Completed job in 17.074530839920044 seconds with state DONE.
2023/11/29 17:22:16 Job[go-testjdbcio_postgresreadwrite-435-3ddff257-56c1-451c-b3a1-b67c7a3b7da2] state: DONE
2023/11/29 17:22:16 🐳 Terminating container: 92be383152cc
2023/11/29 17:22:16 🚫 Container terminated: 92be383152cc
--- PASS: TestJDBCIO_PostgresReadWrite (47.84s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 130.850s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44749
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpv8mv8kdy/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40833
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 50s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/3q7wyh2wzrbiw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4879
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4879/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:46 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:47 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:36:48 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6818178b0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa681817940> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6818180d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f059f2cc160> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f059f2cc280> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f059f2cc790> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f059f2cc820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f059f2cc9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f059f2cca60> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f059f2ccb80> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f059f2ccc10> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f059f2ccca0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f059f2ccd30> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f059f2ccf70> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f059f2cd0d0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f059f2ccee0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f059f2cd040> ====================
INFO root:portable_runner.py:543 starting control server on port 37555
INFO root:portable_runner.py:543 starting data server on port 38397
INFO root:portable_runner.py:543 starting state server on port 46155
INFO root:portable_runner.py:543 starting logging server on port 34963
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d28bf760> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2d06adc4d10e202622334e3f756bb5d2ec4793620c11cf9820a8039922bd83fa', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d28d9550> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'175a4b44d7ef528a9666d29d667212840e8063072579d06661f61668eebd9e31', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.745331525802612 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '39567' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:39567
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:14 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 29, 2023 11:37:15 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6818178b0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa681817940> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6818180d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f059f2cc160> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f059f2cc280> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f059f2cc790> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f059f2cc820> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f059f2cc9d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f059f2cca60> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f059f2ccb80> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f059f2ccc10> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f059f2ccca0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f059f2ccd30> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f059f2ccf70> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f059f2cd0d0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f059f2ccee0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f059f2cd040> ====================
INFO root:portable_runner.py:543 starting control server on port 39553
INFO root:portable_runner.py:543 starting data server on port 44155
INFO root:portable_runner.py:543 starting state server on port 46407
INFO root:portable_runner.py:543 starting logging server on port 35547
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d3c5c040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'63cbcbb18835ac4bb6d8b735ab8affd4a93d046d30687e471e606a458fd1045d', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f05d3c3a430> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'36871f8d00404833ddb26e87435b00cdb9e4688adadac8eebdac650e84bcd9b8', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.595167875289917 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 250.16s (0:04:10) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 355600
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 356172.
Stopping expansion service pid: 356173.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 20s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/7h4vugqh5g5jq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4878
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4878/display/redirect>
Changes:
------------------------------------------
[...truncated 1.37 MB...]
key: "mnSBwjarztIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "mnSBwjarztTimestampedValueCoder"
>
>
coders: <
key: "mnSBwjarztKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mnSBwjarztVarIntCoder"
component_coder_ids: "mnSBwjarztRowCoder"
>
>
coders: <
key: "mnSBwjarztKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mnSBwjarztVarIntCoder"
component_coder_ids: "mnSBwjarztTimestampedValueCoder"
>
>
coders: <
key: "mnSBwjarztKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mnSBwjarztVarIntCoder"
component_coder_ids: "mnSBwjarztIterableCoder"
>
>
coders: <
key: "mnSBwjarztRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$249ea525-6c77-4351-b03e-8c3218acb77d"
>
>
>
coders: <
key: "mnSBwjarztTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006n\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000g\255\345_sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\230\266!\2601\016\334\215\002\352\273A\376*@W\005e\010\014srVo\001\205\366\004s.\001\313\000Dm\3570ors$9z\2164\213\005/\271\347!o\014r\000)oj\220\t\000y.\311\007 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001h\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "mnSBwjarztVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "mnSBwjarztVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "mnSBwjarztbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar\022@18badfe2da8bfc1469b801517feb8f4a1d0ffcdc09b98761b389b6d6b58b6af5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/29 05:22:15 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1701235335458019123
2023/11/29 05:22:18 Prepared job with id: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7 and staging token: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7
2023/11/29 05:22:18 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7
2023/11/29 05:22:18 Submitted job: go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7
2023/11/29 05:22:18 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: STOPPED
2023/11/29 05:22:18 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: STARTING
2023/11/29 05:22:18 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: RUNNING
2023/11/29 05:22:18 2023-11-29 05:22:18. (1): ==================== <function annotate_downstream_side_inputs at 0x7fbe93558160> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fbe93558280> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (3): ==================== <function pack_combiners at 0x7fbe93558790> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (4): ==================== <function lift_combiners at 0x7fbe93558820> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (5): ==================== <function expand_sdf at 0x7fbe935589d0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (6): ==================== <function expand_gbk at 0x7fbe93558a60> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (7): ==================== <function sink_flattens at 0x7fbe93558b80> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (8): ==================== <function greedily_fuse at 0x7fbe93558c10> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (9): ==================== <function read_to_impulse at 0x7fbe93558ca0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (10): ==================== <function impulse_to_input at 0x7fbe93558d30> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (11): ==================== <function sort_stages at 0x7fbe93558f70> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fbe935590d0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (13): ==================== <function setup_timer_mapping at 0x7fbe93558ee0> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (14): ==================== <function populate_data_channel_coders at 0x7fbe93559040> ====================
2023/11/29 05:22:18 2023-11-29 05:22:18. (15): starting control server on port 44203
2023/11/29 05:22:18 2023-11-29 05:22:18. (16): starting data server on port 39035
2023/11/29 05:22:18 2023-11-29 05:22:18. (17): starting state server on port 46575
2023/11/29 05:22:18 2023-11-29 05:22:18. (18): starting logging server on port 38031
2023/11/29 05:22:18 2023-11-29 05:22:18. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbe9041fe80> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/29 05:22:18 2023-11-29 05:22:18. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/29 05:22:19 2023-11-29 05:22:19. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/29 05:22:21 2023-11-29 05:22:21. (22): Waiting for docker to start up. Current status is running
2023/11/29 05:22:21 2023-11-29 05:22:21. (23): Docker container is running. container_id = b'6a5033277ed8c5fb8018df9e3b8cfc724f75b96a5098c5c2ef5a570a6a81b742', worker_id = worker_14
2023/11/29 05:22:22 2023-11-29 05:22:22. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbec7eff190> for environment mnSBwjarztbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/29 05:22:23 2023-11-29 05:22:23. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/29 05:22:23 2023-11-29 05:22:23. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/29 05:22:24 2023-11-29 05:22:24. (27): Waiting for docker to start up. Current status is running
2023/11/29 05:22:24 2023-11-29 05:22:24. (28): Docker container is running. container_id = b'6807e03ee3de65a9851aaa3e8ea126a288311b685e12718a08fed85f258ccbb9', worker_id = worker_15
2023/11/29 05:22:33 2023-11-29 05:22:33. (29): Completed job in 14.358946323394775 seconds with state DONE.
2023/11/29 05:22:33 Job[go-testjdbcio_postgresreadwrite-781-b598e3d0-5efe-4073-93df-13176d7879f7] state: DONE
2023/11/29 05:22:33 🐳 Terminating container: 527505d5bd42
2023/11/29 05:22:33 🚫 Container terminated: 527505d5bd42
--- PASS: TestJDBCIO_PostgresReadWrite (41.85s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 119.128s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.029s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33335
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmppr64sqfe/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 34955
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 27s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/366omwjh3qy34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4877
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4877/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:27 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:27 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:27 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:29 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:29 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:29 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f515e2c59d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f515e2c5a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f515e2c61f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f293ca01280> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f293ca013a0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f293ca018b0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f293ca01940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f293ca01af0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f293ca01b80> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f293ca01ca0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f293ca01d30> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f293ca01dc0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f293ca01e50> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f293ca020d0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f293ca021f0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f293ca02040> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f293ca02160> ====================
INFO root:portable_runner.py:543 starting control server on port 44585
INFO root:portable_runner.py:543 starting data server on port 43329
INFO root:portable_runner.py:543 starting state server on port 46615
INFO root:portable_runner.py:543 starting logging server on port 45281
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2970b8cfd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'21c2b4b2e551426686ee3a419d439222739ab248f94426d71d093bb4040b66c0', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2971306a30> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'30fd5190d82b7346e71044fa45f226c0dde2ad90f7eb529392e4f8300e6b84ae', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 16.302268743515015 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '51729' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:51729
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:55 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:56 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:56 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:57 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:38:59 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:39:01 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f515e2c59d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f515e2c5a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f515e2c61f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f293ca01280> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f293ca013a0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f293ca018b0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f293ca01940> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f293ca01af0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f293ca01b80> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f293ca01ca0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f293ca01d30> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f293ca01dc0> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f293ca01e50> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f293ca020d0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f293ca021f0> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f293ca02040> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f293ca02160> ====================
INFO root:portable_runner.py:543 starting control server on port 39373
INFO root:portable_runner.py:543 starting data server on port 39521
INFO root:portable_runner.py:543 starting state server on port 35811
INFO root:portable_runner.py:543 starting logging server on port 46017
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f29713b3550> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'376cf6ea000a952cef2d6a44e412605d1d6623e1ff55ddc4c66640e7cc03c6d3', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f29380bc880> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8dbe4bc00caddc09b0b4125470f878a28e52c1c70d99569a3843f528c4e811db', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.780715465545654 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 280.16s (0:04:40) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1131900
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1132759.
Stopping expansion service pid: 1132760.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 4s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/byrjpb6uqx5lq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4876
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4876/display/redirect>
Changes:
------------------------------------------
[...truncated 1.49 MB...]
component_coder_ids: "TNgLUJTUgBTimestampedValueCoder"
>
>
coders: <
key: "TNgLUJTUgBKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "TNgLUJTUgBVarIntCoder"
component_coder_ids: "TNgLUJTUgBIterableCoder"
>
>
coders: <
key: "TNgLUJTUgBRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$fc2c2ca1-c55c-4109-807d-ccf841365511"
>
>
>
coders: <
key: "TNgLUJTUgBTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006f\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000(UUID;xp\0001z\263a\375\000\021\001\344\000.\001\344\360L.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_idsr\000\tWdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\235\002\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225a(\020.Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\223[~n\006\002gUW~\177\267\324UG\020\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "TNgLUJTUgBVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "TNgLUJTUgBVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "TNgLUJTUgBbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar\022@18badfe2da8bfc1469b801517feb8f4a1d0ffcdc09b98761b389b6d6b58b6af5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-GLrf4tqL_BRpuAFRf-uPSh0P_NwJuYdhs4m21rWLavU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/28 17:21:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701192065636538465
2023/11/28 17:21:08 Prepared job with id: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5 and staging token: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5
2023/11/28 17:21:08 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5
2023/11/28 17:21:08 Submitted job: go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5
2023/11/28 17:21:08 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: STOPPED
2023/11/28 17:21:08 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: STARTING
2023/11/28 17:21:08 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: RUNNING
2023/11/28 17:21:08 2023-11-28 17:21:08. (1): ==================== <function annotate_downstream_side_inputs at 0x7f19767f4d30> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f19767f4e50> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (3): ==================== <function pack_combiners at 0x7f19767f53a0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (4): ==================== <function lift_combiners at 0x7f19767f5430> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (5): ==================== <function expand_sdf at 0x7f19767f55e0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (6): ==================== <function expand_gbk at 0x7f19767f5670> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (7): ==================== <function sink_flattens at 0x7f19767f5790> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (8): ==================== <function greedily_fuse at 0x7f19767f5820> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (9): ==================== <function read_to_impulse at 0x7f19767f58b0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (10): ==================== <function impulse_to_input at 0x7f19767f5940> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (11): ==================== <function sort_stages at 0x7f19767f5b80> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f19767f5ca0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (13): ==================== <function setup_timer_mapping at 0x7f19767f5af0> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (14): ==================== <function populate_data_channel_coders at 0x7f19767f5c10> ====================
2023/11/28 17:21:08 2023-11-28 17:21:08. (15): starting control server on port 35759
2023/11/28 17:21:08 2023-11-28 17:21:08. (16): starting data server on port 40937
2023/11/28 17:21:08 2023-11-28 17:21:08. (17): starting state server on port 39283
2023/11/28 17:21:08 2023-11-28 17:21:08. (18): starting logging server on port 42703
2023/11/28 17:21:08 2023-11-28 17:21:08. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f19ab144280> for environment TNgLUJTUgBbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/28 17:21:09 2023-11-28 17:21:09. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/28 17:21:09 2023-11-28 17:21:09. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/28 17:21:12 2023-11-28 17:21:12. (22): Waiting for docker to start up. Current status is running
2023/11/28 17:21:12 2023-11-28 17:21:12. (23): Docker container is running. container_id = b'9145aa6862968bdd5830bd310664b26d9cad29ec0cc656f28587f0e93adb724d', worker_id = worker_17
2023/11/28 17:21:13 2023-11-28 17:21:13. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f19ab14d6d0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/28 17:21:15 2023-11-28 17:21:15. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/28 17:21:16 2023-11-28 17:21:16. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/28 17:21:17 2023-11-28 17:21:17. (27): Waiting for docker to start up. Current status is running
2023/11/28 17:21:17 2023-11-28 17:21:17. (28): Docker container is running. container_id = b'a403aa6d7a12bb3da35e4a5a86bf3354afc8b162dc6e6e7dd59d6f4df14e5900', worker_id = worker_19
2023/11/28 17:21:20 2023-11-28 17:21:20. (29): Completed job in 12.165110349655151 seconds with state DONE.
2023/11/28 17:21:20 Job[go-testjdbcio_postgresreadwrite-6-00acba64-06cc-4ca7-9825-a0c8652cf9a5] state: DONE
2023/11/28 17:21:20 🐳 Terminating container: 618fc3f55ecf
2023/11/28 17:21:21 🚫 Container terminated: 618fc3f55ecf
--- PASS: TestJDBCIO_PostgresReadWrite (37.32s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 119.767s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44747
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmphto89l9o/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 45825
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 17s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xapizoejgwiho
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4875
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4875/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:36:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f4aa2acf430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f4aa2acf4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f4aa2acfc10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4557fc5ca0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4557fc5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4557fc6310> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4557fc63a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4557fc6550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4557fc65e0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4557fc6700> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4557fc6790> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4557fc6820> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4557fc68b0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4557fc6af0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4557fc6c10> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4557fc6a60> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4557fc6b80> ====================
INFO root:portable_runner.py:543 starting control server on port 42969
INFO root:portable_runner.py:543 starting data server on port 36227
INFO root:portable_runner.py:543 starting state server on port 34659
INFO root:portable_runner.py:543 starting logging server on port 37545
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f457f1b4eb0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bb009b4c4102bf06972acb4029e82a7afa86427aeb2512baadda6625e3cf8279', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458c0a3790> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7eb83ac123fb3219560fe6f8d0cc1e676e15cc68c082aabf1464f8f6793a007f', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.928049087524414 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '50725' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:50725
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:05 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:06 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:06 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:08 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 11:37:09 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f4aa2acf430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f4aa2acf4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f4aa2acfc10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4557fc5ca0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4557fc5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4557fc6310> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4557fc63a0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4557fc6550> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4557fc65e0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4557fc6700> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4557fc6790> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4557fc6820> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4557fc68b0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4557fc6af0> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4557fc6c10> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4557fc6a60> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4557fc6b80> ====================
INFO root:portable_runner.py:543 starting control server on port 36297
INFO root:portable_runner.py:543 starting data server on port 43125
INFO root:portable_runner.py:543 starting state server on port 39515
INFO root:portable_runner.py:543 starting logging server on port 39039
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458c01b6d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'05a7e84b26c5db7a1bc69e405ca55b932344703029805f4dcaf818ed2873f6e8', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458c03a3d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'70d460748e7a302840128989f3446741e50a957da36cb58dfb4d8003cc7299b0', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.1183180809021 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 249.90s (0:04:09) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3292837
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3293383.
Stopping expansion service pid: 3293384.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 11s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xaeyd5fyddo34
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4874
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4874/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:07 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:07 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:07 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:09 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:09 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:09 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fcbe4643550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fcbe46435e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fcbe4643d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc9f75f8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc9f75f8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc9f75f9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc9f75f94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc9f75f9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc9f75f9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc9f75f9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc9f75f98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc9f75f9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc9f75f99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc9f75f9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc9f75f9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc9f75f9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc9f75f9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38345
INFO root:portable_runner.py:543 starting data server on port 43603
INFO root:portable_runner.py:543 starting state server on port 43373
INFO root:portable_runner.py:543 starting logging server on port 36721
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2be6f7f0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bafbd9b6d251071e7d600c3fab817f388df30ebb6a5646f32c99feb071dbe8fa', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2bea0760> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e3bb99b38cecd647ec5089aeeeee07b8ae26845edce9ddc9db45171efb0b3ac7', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.911068439483643 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '34139' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:34139
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:32 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:34 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:36 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 28, 2023 5:36:37 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fcbe4643550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fcbe46435e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fcbe4643d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fc9f75f8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fc9f75f8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fc9f75f9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fc9f75f94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fc9f75f9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fc9f75f9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fc9f75f9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fc9f75f98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fc9f75f9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fc9f75f99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fc9f75f9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fc9f75f9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fc9f75f9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fc9f75f9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 33709
INFO root:portable_runner.py:543 starting data server on port 33087
INFO root:portable_runner.py:543 starting state server on port 42269
INFO root:portable_runner.py:543 starting logging server on port 39357
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2be98ac0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4c0ba66e5bb23330175b691ec808c021fd595725fecfc78aecaa7890346147d8', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca2be9aa00> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a18c022adefd172d36e86da79bc23a753238aafa2eeb9ceefd989c886777ed23', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 14.971205711364746 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 246.90s (0:04:06) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2948234
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2948766.
Stopping expansion service pid: 2948767.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 37s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wijgrypuj3zuy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4873
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4873/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:22 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:22 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f56b6dc3550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f56b6dc35e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f56b6dc3d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f580e145dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f580e145ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f580e146430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f580e1464c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f580e146670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f580e146700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f580e146820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f580e1468b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f580e146940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f580e1469d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f580e146c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f580e146d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f580e146b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f580e146ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 43505
INFO root:portable_runner.py:543 starting data server on port 34393
INFO root:portable_runner.py:543 starting state server on port 38249
INFO root:portable_runner.py:543 starting logging server on port 35113
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f58423dae50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'1833cc27871d6736c35c3a613eb086836bba63ae290382bc1bb7a3e355f9bd8d', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5842a40b80> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'57a71893ac82523394b74cc2de2464169c4ad18aa357ee674f6652b1f1e4c4e7', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.805030107498169 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '54227' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:54227
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:49 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:50 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:50 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:50 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:52 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 11:38:54 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f56b6dc3550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f56b6dc35e0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f56b6dc3d30> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f580e145dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f580e145ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f580e146430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f580e1464c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f580e146670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f580e146700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f580e146820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f580e1468b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f580e146940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f580e1469d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f580e146c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f580e146d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f580e146b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f580e146ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 39819
INFO root:portable_runner.py:543 starting data server on port 34055
INFO root:portable_runner.py:543 starting state server on port 42287
INFO root:portable_runner.py:543 starting logging server on port 45323
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5842381730> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd9a68c919d23e7e2bec32a0abe07dd1a5bb0408484c9a8feaf167778631da496', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5842a1a670> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'6d34e5f3705561d778a7c359c525e663aedead34c1303d9719769547d0d88d9c', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.58764362335205 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 262.28s (0:04:22) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 49531
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 50362.
Stopping expansion service pid: 50363.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 56s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ehmwe2hjlahus
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4872
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4872/display/redirect?page=changes>
Changes:
[noreply] Respect useReflectApi parameter (#29518)
------------------------------------------
[...truncated 1.50 MB...]
component_coder_ids: "NcmAAlHcwmTimestampedValueCoder"
>
>
coders: <
key: "NcmAAlHcwmKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "NcmAAlHcwmVarIntCoder"
component_coder_ids: "NcmAAlHcwmIterableCoder"
>
>
coders: <
key: "NcmAAlHcwmRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$9b634edd-5a06-4b9c-bc0f-dc486c6715e3"
>
>
>
coders: <
key: "NcmAAlHcwmTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\231\302j\nsr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\260\275V\261s-u\276\356<\316ZP\300C\360\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "NcmAAlHcwmVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "NcmAAlHcwmVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "NcmAAlHcwmbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YJy_D65_0s8MhKzuzafcrJW-TBwDDyfR_sVOEOG27e0.jar\022@609cbf0fae7fd2cf0c84aceecda7dcac95be4c1c030f27d1fec54e10e1b6eded"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YJy_D65_0s8MhKzuzafcrJW-TBwDDyfR_sVOEOG27e0.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/27 17:21:21 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701105681696532349
2023/11/27 17:21:24 Prepared job with id: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f and staging token: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f
2023/11/27 17:21:24 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f
2023/11/27 17:21:24 Submitted job: go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f
2023/11/27 17:21:24 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: STOPPED
2023/11/27 17:21:24 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: STARTING
2023/11/27 17:21:24 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: RUNNING
2023/11/27 17:21:24 2023-11-27 17:21:24. (1): ==================== <function annotate_downstream_side_inputs at 0x7f7420f6adc0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f7420f6aee0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (3): ==================== <function pack_combiners at 0x7f7420f6b430> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (4): ==================== <function lift_combiners at 0x7f7420f6b4c0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (5): ==================== <function expand_sdf at 0x7f7420f6b670> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (6): ==================== <function expand_gbk at 0x7f7420f6b700> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (7): ==================== <function sink_flattens at 0x7f7420f6b820> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (8): ==================== <function greedily_fuse at 0x7f7420f6b8b0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (9): ==================== <function read_to_impulse at 0x7f7420f6b940> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (10): ==================== <function impulse_to_input at 0x7f7420f6b9d0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (11): ==================== <function sort_stages at 0x7f7420f6bc10> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f7420f6bd30> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (13): ==================== <function setup_timer_mapping at 0x7f7420f6bb80> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (14): ==================== <function populate_data_channel_coders at 0x7f7420f6bca0> ====================
2023/11/27 17:21:24 2023-11-27 17:21:24. (15): starting control server on port 33601
2023/11/27 17:21:24 2023-11-27 17:21:24. (16): starting data server on port 36739
2023/11/27 17:21:24 2023-11-27 17:21:24. (17): starting state server on port 35171
2023/11/27 17:21:24 2023-11-27 17:21:24. (18): starting logging server on port 34705
2023/11/27 17:21:24 2023-11-27 17:21:24. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f745507e310> for environment NcmAAlHcwmbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/27 17:21:28 2023-11-27 17:21:28. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/27 17:21:28 2023-11-27 17:21:28. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/27 17:21:29 2023-11-27 17:21:29. (22): Waiting for docker to start up. Current status is running
2023/11/27 17:21:29 2023-11-27 17:21:29. (23): Docker container is running. container_id = b'828f1675304bdcdd1fcc946684c2e8ad2b012c46cb768504eeb58f42b9cfaad8', worker_id = worker_17
2023/11/27 17:21:30 2023-11-27 17:21:30. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7455085e80> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/27 17:21:33 2023-11-27 17:21:33. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/27 17:21:34 2023-11-27 17:21:34. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/27 17:21:35 2023-11-27 17:21:35. (27): Waiting for docker to start up. Current status is running
2023/11/27 17:21:35 2023-11-27 17:21:35. (28): Docker container is running. container_id = b'559ecd6b28fd0746e30f8c6e4cf497c94d60c47e2dd679641b0a82ce871a82dc', worker_id = worker_19
2023/11/27 17:21:38 2023-11-27 17:21:38. (29): Completed job in 14.312059879302979 seconds with state DONE.
2023/11/27 17:21:38 Job[go-testjdbcio_postgresreadwrite-91-3597dc0d-3d2b-4c9c-936d-d0dc4715ef3f] state: DONE
2023/11/27 17:21:38 🐳 Terminating container: d40bc6b61e21
2023/11/27 17:21:39 🚫 Container terminated: d40bc6b61e21
--- PASS: TestJDBCIO_PostgresReadWrite (41.15s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 127.133s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.026s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42433
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpol7d77g5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 34581
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 30m 30s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xtar7jl6ue5z4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4871
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4871/display/redirect>
Changes:
------------------------------------------
[...truncated 1.51 MB...]
key: "hUoQgeNCUPIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "hUoQgeNCUPTimestampedValueCoder"
>
>
coders: <
key: "hUoQgeNCUPKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "hUoQgeNCUPVarIntCoder"
component_coder_ids: "hUoQgeNCUPRowCoder"
>
>
coders: <
key: "hUoQgeNCUPKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "hUoQgeNCUPVarIntCoder"
component_coder_ids: "hUoQgeNCUPTimestampedValueCoder"
>
>
coders: <
key: "hUoQgeNCUPKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "hUoQgeNCUPVarIntCoder"
component_coder_ids: "hUoQgeNCUPIterableCoder"
>
>
coders: <
key: "hUoQgeNCUPRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$939db966-bc08-431f-97d8-6757c9bd72a0"
>
>
>
coders: <
key: "hUoQgeNCUPTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\216\005\353\353sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\266\224\343J\352\373\366,\306\036E\246\347\375K\355\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "hUoQgeNCUPVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "hUoQgeNCUPVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "hUoQgeNCUPbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/27 11:20:33 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1701084033484314365
2023/11/27 11:20:35 Prepared job with id: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0 and staging token: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0
2023/11/27 11:20:36 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0
2023/11/27 11:20:36 Submitted job: go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0
2023/11/27 11:20:36 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: STOPPED
2023/11/27 11:20:36 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: STARTING
2023/11/27 11:20:36 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: RUNNING
2023/11/27 11:20:36 2023-11-27 11:20:36. (1): ==================== <function annotate_downstream_side_inputs at 0x7f2744f53dc0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f2744f53ee0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (3): ==================== <function pack_combiners at 0x7f2744f54430> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (4): ==================== <function lift_combiners at 0x7f2744f544c0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (5): ==================== <function expand_sdf at 0x7f2744f54670> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (6): ==================== <function expand_gbk at 0x7f2744f54700> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (7): ==================== <function sink_flattens at 0x7f2744f54820> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (8): ==================== <function greedily_fuse at 0x7f2744f548b0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (9): ==================== <function read_to_impulse at 0x7f2744f54940> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (10): ==================== <function impulse_to_input at 0x7f2744f549d0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (11): ==================== <function sort_stages at 0x7f2744f54c10> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f2744f54d30> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (13): ==================== <function setup_timer_mapping at 0x7f2744f54b80> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (14): ==================== <function populate_data_channel_coders at 0x7f2744f54ca0> ====================
2023/11/27 11:20:36 2023-11-27 11:20:36. (15): starting control server on port 46661
2023/11/27 11:20:36 2023-11-27 11:20:36. (16): starting data server on port 45741
2023/11/27 11:20:36 2023-11-27 11:20:36. (17): starting state server on port 33325
2023/11/27 11:20:36 2023-11-27 11:20:36. (18): starting logging server on port 37317
2023/11/27 11:20:36 2023-11-27 11:20:36. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f27799277c0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/27 11:20:36 2023-11-27 11:20:36. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/27 11:20:36 2023-11-27 11:20:36. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/27 11:20:42 2023-11-27 11:20:42. (22): Waiting for docker to start up. Current status is running
2023/11/27 11:20:42 2023-11-27 11:20:42. (23): Docker container is running. container_id = b'bc55dadb1a98c653cff34f07e2e67cc0dec06cbfee3b205db1f30032e720ffe7', worker_id = worker_16
2023/11/27 11:20:43 2023-11-27 11:20:43. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2779821550> for environment hUoQgeNCUPbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/27 11:20:45 2023-11-27 11:20:45. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/27 11:20:46 2023-11-27 11:20:46. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/27 11:20:47 2023-11-27 11:20:47. (27): Waiting for docker to start up. Current status is running
2023/11/27 11:20:47 2023-11-27 11:20:47. (28): Docker container is running. container_id = b'75e999c9cdf52fc97180f1e24d0dda119f6e463e5236d337d08f99af417957dd', worker_id = worker_18
2023/11/27 11:20:53 2023-11-27 11:20:53. (29): Completed job in 17.105385780334473 seconds with state DONE.
2023/11/27 11:20:53 Job[go-testjdbcio_postgresreadwrite-835-578eae9e-f4f8-4314-b1cc-2b47febbfbe0] state: DONE
2023/11/27 11:20:53 🐳 Terminating container: 64967ed720fa
2023/11/27 11:20:53 🚫 Container terminated: 64967ed720fa
--- PASS: TestJDBCIO_PostgresReadWrite (45.94s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 128.289s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40429
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpo9297b7f/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42975
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 9s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/chcahva3dpwzm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4870
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4870/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:39107.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:17 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:17 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:17 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc5488663a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc548866430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc548866b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f13a78d4dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f13a78d4ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f13a78d6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f13a78d64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f13a78d6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f13a78d6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f13a78d6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f13a78d68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f13a78d6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f13a78d69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f13a78d6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f13a78d6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f13a78d6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f13a78d6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 45277
INFO root:portable_runner.py:543 starting data server on port 38153
INFO root:portable_runner.py:543 starting state server on port 45869
INFO root:portable_runner.py:543 starting logging server on port 38837
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13dc217640> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fc9ca506b875b357207c1099b82bad86b6db456053d4c2d5ca9aa9f76b1e7236', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13dc22f4c0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'930b25127ba82732990f65dfc1334a675e89cf545afac38cdc4582243c2ec822', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.158214807510376 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57197' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:57197
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:43 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:44 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:46 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 27, 2023 5:39:48 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc5488663a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc548866430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc548866b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f13a78d4dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f13a78d4ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f13a78d6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f13a78d64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f13a78d6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f13a78d6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f13a78d6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f13a78d68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f13a78d6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f13a78d69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f13a78d6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f13a78d6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f13a78d6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f13a78d6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 43831
INFO root:portable_runner.py:543 starting data server on port 45481
INFO root:portable_runner.py:543 starting state server on port 39057
INFO root:portable_runner.py:543 starting logging server on port 42365
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13a4769610> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'47e6a8b134ec51e2654ba46cbfaa95d7075187cc5c03a0c8ccbbb25b7ae63b0b', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f13dbdee430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fe2224b543539e40209f992bdf193a764335ff3d724d099bca2914eb2f344439', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.324857711791992 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 267.37s (0:04:27) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3888621
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3889143.
Stopping expansion service pid: 3889144.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 29m 25s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ukdmrggqim3gm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4869
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4869/display/redirect>
Changes:
------------------------------------------
[...truncated 1.57 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:42 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6965ecd3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6965ecd430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6965ecdb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f33a61f3dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f33a61f3ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f33a61f4430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f33a61f44c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f33a61f4670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f33a61f4700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f33a61f4820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f33a61f48b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f33a61f4940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f33a61f49d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f33a61f4c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f33a61f4d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f33a61f4b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f33a61f4ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38887
INFO root:portable_runner.py:543 starting data server on port 44305
INFO root:portable_runner.py:543 starting state server on port 36873
INFO root:portable_runner.py:543 starting logging server on port 37565
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33daa76ca0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'09ac3e8f05d64e24a129248420919462762f855616e15cf2fb4eb4926c729c4c', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33dab22bb0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ff1722c4ba78dd1c2cbe78b82b28f2c9b6b3e26e7e522b94e2022d6898800768', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.123701572418213 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '60029' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:60029
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:09 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:12 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 11:37:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6965ecd3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6965ecd430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6965ecdb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f33a61f3dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f33a61f3ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f33a61f4430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f33a61f44c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f33a61f4670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f33a61f4700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f33a61f4820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f33a61f48b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f33a61f4940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f33a61f49d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f33a61f4c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f33a61f4d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f33a61f4b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f33a61f4ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 33705
INFO root:portable_runner.py:543 starting data server on port 40973
INFO root:portable_runner.py:543 starting state server on port 37507
INFO root:portable_runner.py:543 starting logging server on port 39317
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33dabc8940> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'838f24a8e84f6264afe46551fc842e4a3497b3e1c69a0a151c1076e6d0060f0f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f33d9fcc730> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c7883d3998eab7c1992f132ad9242ee9b2077f31cec06c9ac1b45a25e95588c9', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 17.133368253707886 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 258.81s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 933482
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 934608.
Stopping expansion service pid: 934609.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 17s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/z2rybkro6n2jo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4868
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4868/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:37 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:37 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:37 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fdb1bfa13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fdb1bfa1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fdb1bfa1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe972073dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe972073ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe972074430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe9720744c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe972074670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe972074700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe972074820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe9720748b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe972074940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe9720749d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe972074c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe972074d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe972074b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe972074ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 46419
INFO root:portable_runner.py:543 starting data server on port 39435
INFO root:portable_runner.py:543 starting state server on port 40731
INFO root:portable_runner.py:543 starting logging server on port 35169
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5ab5c70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ef5495b93722296a13a33d5e01c11f0289d74b7422a7ec5bb3214b01f8808c5a', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5a85640> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3be114c5aeb71376d9d1b498142e7a812be30c4ac289cc6d41b92a702ddd6209', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 17.249269247055054 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '54491' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:54491
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:05 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:06 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:08 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:10 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fdb1bfa13a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fdb1bfa1430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fdb1bfa1b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe972073dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe972073ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe972074430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe9720744c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe972074670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe972074700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe972074820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe9720748b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe972074940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe9720749d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe972074c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe972074d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe972074b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe972074ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 41389
INFO root:portable_runner.py:543 starting data server on port 40757
INFO root:portable_runner.py:543 starting state server on port 40441
INFO root:portable_runner.py:543 starting logging server on port 32843
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5abe640> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3d1c91bf15af93da19211607b3846b0d81d8fe9a3c103c85da2c5f1b185961ac', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe9a5a6c4f0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fe1d132b2efc881516982e802741f39e135721f6251de69aa1065e83e3987273', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 17.05565643310547 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 258.79s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 719601
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 720174.
Stopping expansion service pid: 720175.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 13s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wcmby55czx5am
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4867
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4867/display/redirect>
Changes:
------------------------------------------
[...truncated 1.56 MB...]
component_coder_ids: "GakgXZPzsETimestampedValueCoder"
>
>
coders: <
key: "GakgXZPzsEKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "GakgXZPzsEVarIntCoder"
component_coder_ids: "GakgXZPzsEIterableCoder"
>
>
coders: <
key: "GakgXZPzsERowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$89f5f616-c7ec-472c-aa6c-1fec77801c37"
>
>
>
coders: <
key: "GakgXZPzsETimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000A\032\270\034sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\212\223\336'\362,b\370s\322\227\312\031\241O\177\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "GakgXZPzsEVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "GakgXZPzsEVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "GakgXZPzsEbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/26 11:29:28 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700998168983778685
2023/11/26 11:29:31 Prepared job with id: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8 and staging token: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8
2023/11/26 11:29:31 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8
2023/11/26 11:29:31 Submitted job: go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8
2023/11/26 11:29:31 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: STOPPED
2023/11/26 11:29:31 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: STARTING
2023/11/26 11:29:31 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: RUNNING
2023/11/26 11:29:31 2023-11-26 11:29:31. (1): ==================== <function annotate_downstream_side_inputs at 0x7f47db91cdc0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f47db91cee0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (3): ==================== <function pack_combiners at 0x7f47db91d430> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (4): ==================== <function lift_combiners at 0x7f47db91d4c0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (5): ==================== <function expand_sdf at 0x7f47db91d670> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (6): ==================== <function expand_gbk at 0x7f47db91d700> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (7): ==================== <function sink_flattens at 0x7f47db91d820> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (8): ==================== <function greedily_fuse at 0x7f47db91d8b0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (9): ==================== <function read_to_impulse at 0x7f47db91d940> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (10): ==================== <function impulse_to_input at 0x7f47db91d9d0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (11): ==================== <function sort_stages at 0x7f47db91dc10> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f47db91dd30> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (13): ==================== <function setup_timer_mapping at 0x7f47db91db80> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (14): ==================== <function populate_data_channel_coders at 0x7f47db91dca0> ====================
2023/11/26 11:29:31 2023-11-26 11:29:31. (15): starting control server on port 36215
2023/11/26 11:29:31 2023-11-26 11:29:31. (16): starting data server on port 32879
2023/11/26 11:29:31 2023-11-26 11:29:31. (17): starting state server on port 41237
2023/11/26 11:29:31 2023-11-26 11:29:31. (18): starting logging server on port 34395
2023/11/26 11:29:31 2023-11-26 11:29:31. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4808304220> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/26 11:29:35 2023-11-26 11:29:35. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/26 11:29:35 2023-11-26 11:29:35. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/26 11:29:36 2023-11-26 11:29:36. (22): Waiting for docker to start up. Current status is running
2023/11/26 11:29:36 2023-11-26 11:29:36. (23): Docker container is running. container_id = b'd572e8fc854431f806186630cded53c6b29d230ccf19342c28f8dfc1039bb0f3', worker_id = worker_17
2023/11/26 11:29:37 2023-11-26 11:29:37. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f480faaf190> for environment GakgXZPzsEbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/26 11:29:40 2023-11-26 11:29:40. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/26 11:29:40 2023-11-26 11:29:40. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/26 11:29:42 2023-11-26 11:29:42. (27): Waiting for docker to start up. Current status is running
2023/11/26 11:29:42 2023-11-26 11:29:42. (28): Docker container is running. container_id = b'3f12f8b3a6d694ea8e51f03072f95a721a8c90585bc386fb8c810b3520863e3d', worker_id = worker_19
2023/11/26 11:29:49 2023-11-26 11:29:49. (29): Completed job in 17.36914610862732 seconds with state DONE.
2023/11/26 11:29:49 Job[go-testjdbcio_postgresreadwrite-168-96e6d0cc-2b7d-44f9-a9d6-81e441a23fa8] state: DONE
2023/11/26 11:29:49 🐳 Terminating container: af503f7061ed
2023/11/26 11:29:51 🚫 Container terminated: af503f7061ed
--- PASS: TestJDBCIO_PostgresReadWrite (49.13s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 134.776s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33049
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpcpcz0df_/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42191
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 43s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/hp3az4xal64q2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4866
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4866/display/redirect>
Changes:
------------------------------------------
[...truncated 1.74 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:41 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:41 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:42 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:36:44 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe97daa33a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe97daa3430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe97daa3b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f53cf6a2dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f53cf6a2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f53cf6a3430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f53cf6a34c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f53cf6a3670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f53cf6a3700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f53cf6a3820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f53cf6a38b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f53cf6a3940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f53cf6a39d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f53cf6a3c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f53cf6a3d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f53cf6a3b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f53cf6a3ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 42595
INFO root:portable_runner.py:543 starting data server on port 42143
INFO root:portable_runner.py:543 starting state server on port 42827
INFO root:portable_runner.py:543 starting logging server on port 34625
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402aa8730> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'842e87397b2fe252afcfdabd9341fb694e9e7c768174b601b3eaf20b72f211a9', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402aa1790> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'dbecb72fa9e41eea4d9f31297dc4edd193628f184d91f3e3381a7c96cd78e76e', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.315377235412598 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '41977' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:41977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:08 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:09 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:11 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 26, 2023 5:37:13 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe97daa33a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe97daa3430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe97daa3b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f53cf6a2dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f53cf6a2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f53cf6a3430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f53cf6a34c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f53cf6a3670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f53cf6a3700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f53cf6a3820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f53cf6a38b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f53cf6a3940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f53cf6a39d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f53cf6a3c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f53cf6a3d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f53cf6a3b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f53cf6a3ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 41239
INFO root:portable_runner.py:543 starting data server on port 40605
INFO root:portable_runner.py:543 starting state server on port 38029
INFO root:portable_runner.py:543 starting logging server on port 42021
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402a21fa0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'84b56de02b3d7d5cc9c29b197c730a3f08ae379bb5fc3466dc2d86c8af984576', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5402a31640> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'31019d67cc78cb46cfeff037845652554005e92743622388f531dd42e41fa460', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 18.08107018470764 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 263.35s (0:04:23) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4039999
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4041289.
Stopping expansion service pid: 4041290.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 18s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cwx2q66cffogw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4865
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4865/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
key: "mbgxUdnLleIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "mbgxUdnLleTimestampedValueCoder"
>
>
coders: <
key: "mbgxUdnLleKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mbgxUdnLleVarIntCoder"
component_coder_ids: "mbgxUdnLleRowCoder"
>
>
coders: <
key: "mbgxUdnLleKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mbgxUdnLleVarIntCoder"
component_coder_ids: "mbgxUdnLleTimestampedValueCoder"
>
>
coders: <
key: "mbgxUdnLleKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "mbgxUdnLleVarIntCoder"
component_coder_ids: "mbgxUdnLleIterableCoder"
>
>
coders: <
key: "mbgxUdnLleRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$f832e729-743c-47d5-9223-8edd2d3f63f2"
>
>
>
coders: <
key: "mbgxUdnLleTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\260\220K\340sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\270\317\003\200\334$S\016 \2627I\323QK&\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "mbgxUdnLleVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "mbgxUdnLleVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "mbgxUdnLlebeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/25 23:20:14 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700954414113621893
2023/11/25 23:20:16 Prepared job with id: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab and staging token: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab
2023/11/25 23:20:16 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab
2023/11/25 23:20:16 Submitted job: go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab
2023/11/25 23:20:16 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: STOPPED
2023/11/25 23:20:16 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: STARTING
2023/11/25 23:20:16 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: RUNNING
2023/11/25 23:20:16 2023-11-25 23:20:16. (1): ==================== <function annotate_downstream_side_inputs at 0x7f269ccd9dc0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f269ccd9ee0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (3): ==================== <function pack_combiners at 0x7f269ccda430> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (4): ==================== <function lift_combiners at 0x7f269ccda4c0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (5): ==================== <function expand_sdf at 0x7f269ccda670> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (6): ==================== <function expand_gbk at 0x7f269ccda700> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (7): ==================== <function sink_flattens at 0x7f269ccda820> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (8): ==================== <function greedily_fuse at 0x7f269ccda8b0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (9): ==================== <function read_to_impulse at 0x7f269ccda940> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (10): ==================== <function impulse_to_input at 0x7f269ccda9d0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (11): ==================== <function sort_stages at 0x7f269ccdac10> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f269ccdad30> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (13): ==================== <function setup_timer_mapping at 0x7f269ccdab80> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (14): ==================== <function populate_data_channel_coders at 0x7f269ccdaca0> ====================
2023/11/25 23:20:16 2023-11-25 23:20:16. (15): starting control server on port 44603
2023/11/25 23:20:16 2023-11-25 23:20:16. (16): starting data server on port 37907
2023/11/25 23:20:16 2023-11-25 23:20:16. (17): starting state server on port 33065
2023/11/25 23:20:16 2023-11-25 23:20:16. (18): starting logging server on port 46513
2023/11/25 23:20:16 2023-11-25 23:20:16. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26d06928b0> for environment mbgxUdnLlebeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/25 23:20:20 2023-11-25 23:20:20. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/25 23:20:21 2023-11-25 23:20:21. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/25 23:20:22 2023-11-25 23:20:22. (22): Waiting for docker to start up. Current status is running
2023/11/25 23:20:22 2023-11-25 23:20:22. (23): Docker container is running. container_id = b'25e05a7549c25a1b93d5ae5609d7a3871095b6e9aa43a8eda6ab2238753378db', worker_id = worker_17
2023/11/25 23:20:23 2023-11-25 23:20:23. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26d06381f0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/25 23:20:25 2023-11-25 23:20:25. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/25 23:20:26 2023-11-25 23:20:26. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/25 23:20:27 2023-11-25 23:20:27. (27): Waiting for docker to start up. Current status is running
2023/11/25 23:20:27 2023-11-25 23:20:27. (28): Docker container is running. container_id = b'0bbfd0509db7e63f90f45f2c4f0fbc2b06bca37bff72717acc72c6c64ffd9978', worker_id = worker_19
2023/11/25 23:20:30 2023-11-25 23:20:30. (29): Completed job in 13.989140272140503 seconds with state DONE.
2023/11/25 23:20:30 Job[go-testjdbcio_postgresreadwrite-790-3a1f1964-63a4-463a-8b18-2f2a0f081eab] state: DONE
2023/11/25 23:20:30 🐳 Terminating container: 518eee93d188
2023/11/25 23:20:31 🚫 Container terminated: 518eee93d188
--- PASS: TestJDBCIO_PostgresReadWrite (45.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 104.704s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39301
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp82ydz3mc/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38469
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 57s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cfefgmh7ehety
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4864
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4864/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "XymmTxWVVDVarIntCoder"
component_coder_ids: "XymmTxWVVDTimestampedValueCoder"
>
>
coders: <
key: "XymmTxWVVDKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "XymmTxWVVDVarIntCoder"
component_coder_ids: "XymmTxWVVDIterableCoder"
>
>
coders: <
key: "XymmTxWVVDRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$75b24255-90a3-4e57-a3b8-6e91fc0304c4"
>
>
>
coders: <
key: "XymmTxWVVDTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000fo\3576sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\244%?%!\023\233\247\327\212\324\373\275#G\233\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "XymmTxWVVDVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "XymmTxWVVDVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "XymmTxWVVDbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar\022@36e3a94d460e58fef0fc5a24ee17af10c8dcf3351be78dc47d04e9b04d7bb949"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-NuOpTUYOWP7w_Fok7hevEMjc8zUb543EfQTpsE17uUk.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/25 17:20:51 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700932851950145836
2023/11/25 17:20:54 Prepared job with id: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474 and staging token: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474
2023/11/25 17:20:54 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474
2023/11/25 17:20:54 Submitted job: go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474
2023/11/25 17:20:54 2023-11-25 17:20:54. (5): ==================== <function expand_sdf at 0x7fe584d94670> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (6): ==================== <function expand_gbk at 0x7fe584d94700> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (7): ==================== <function sink_flattens at 0x7fe584d94820> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (8): ==================== <function greedily_fuse at 0x7fe584d948b0> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (9): ==================== <function read_to_impulse at 0x7fe584d94940> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (10): ==================== <function impulse_to_input at 0x7fe584d949d0> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (11): ==================== <function sort_stages at 0x7fe584d94c10> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fe584d94d30> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (13): ==================== <function setup_timer_mapping at 0x7fe584d94b80> ====================
2023/11/25 17:20:54 2023-11-25 17:20:54. (14): ==================== <function populate_data_channel_coders at 0x7fe584d94ca0> ====================
2023/11/25 17:20:54 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: STOPPED
2023/11/25 17:20:54 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: STARTING
2023/11/25 17:20:54 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: RUNNING
2023/11/25 17:20:54 2023-11-25 17:20:54. (15): starting control server on port 39771
2023/11/25 17:20:54 2023-11-25 17:20:54. (16): starting data server on port 46767
2023/11/25 17:20:54 2023-11-25 17:20:54. (17): starting state server on port 35063
2023/11/25 17:20:54 2023-11-25 17:20:54. (18): starting logging server on port 42877
2023/11/25 17:20:54 2023-11-25 17:20:54. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe5b96c0820> for environment XymmTxWVVDbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/25 17:20:58 2023-11-25 17:20:58. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/25 17:20:59 2023-11-25 17:20:59. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/25 17:21:00 2023-11-25 17:21:00. (22): Waiting for docker to start up. Current status is running
2023/11/25 17:21:00 2023-11-25 17:21:00. (23): Docker container is running. container_id = b'403def393187fed0d0745f9289487eeb542a61eeb46742b86c9913b101c2592a', worker_id = worker_17
2023/11/25 17:21:01 2023-11-25 17:21:01. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe5b9665400> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/25 17:21:03 2023-11-25 17:21:03. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/25 17:21:04 2023-11-25 17:21:04. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/25 17:21:05 2023-11-25 17:21:05. (27): Waiting for docker to start up. Current status is running
2023/11/25 17:21:05 2023-11-25 17:21:05. (28): Docker container is running. container_id = b'd28d0c1c13a59d530cbedda4c211acebc91b052fba4e3bc55b720d01de3a3a2b', worker_id = worker_19
2023/11/25 17:21:08 2023-11-25 17:21:08. (29): Completed job in 14.056246995925903 seconds with state DONE.
2023/11/25 17:21:08 Job[go-testjdbcio_postgresreadwrite-2-26e9cf99-402b-4627-bc42-580a7d447474] state: DONE
2023/11/25 17:21:08 🐳 Terminating container: 6fdf8c80df5a
2023/11/25 17:21:09 🚫 Container terminated: 6fdf8c80df5a
--- PASS: TestJDBCIO_PostgresReadWrite (43.01s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 122.307s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39087
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmps075rlmw/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 46751
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 18s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/shtlsvynx5mmc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4863
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4863/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:22 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:24 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feebb16f3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feebb16f430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feebb16fb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fcbed0f5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fcbed0f5ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fcbed0f6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fcbed0f64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fcbed0f6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fcbed0f6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fcbed0f6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fcbed0f68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fcbed0f6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fcbed0f69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fcbed0f6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fcbed0f6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fcbed0f6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fcbed0f6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 35771
INFO root:portable_runner.py:543 starting data server on port 35275
INFO root:portable_runner.py:543 starting state server on port 42765
INFO root:portable_runner.py:543 starting logging server on port 34173
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc20768520> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2823f09bbcfda332a5e79762be586f1bcccccc72378c4e38497ed7b558a07b70', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc206cd940> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'96b2d9f8e95bad1441570b1990f7df93fa07054fd22eb4f5be39a6e1acd60dd9', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.229727506637573 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '53585' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:53585
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:48 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:49 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:52 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 11:36:53 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feebb16f3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feebb16f430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feebb16fb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fcbed0f5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fcbed0f5ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fcbed0f6430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fcbed0f64c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fcbed0f6670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fcbed0f6700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fcbed0f6820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fcbed0f68b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fcbed0f6940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fcbed0f69d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fcbed0f6c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fcbed0f6d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fcbed0f6b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fcbed0f6ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38585
INFO root:portable_runner.py:543 starting data server on port 38931
INFO root:portable_runner.py:543 starting state server on port 41229
INFO root:portable_runner.py:543 starting logging server on port 44441
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc2064cc10> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b3fc96791e6a1a6e8baa886a6746082a10f5e20da05f1a89c9b2dc3ad629149f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc2065d970> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e130e13fbb3b25a67c42f6c1c830a26ec743830e7236ef190e71e156f8538938', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.614453315734863 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 262.65s (0:04:22) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2874226
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2874744.
Stopping expansion service pid: 2874745.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 57s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/folpzjjp6njau
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4862
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4862/display/redirect>
Changes:
------------------------------------------
[...truncated 932.17 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb6ef3ee3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb6ef3ee430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb6ef3eeb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fac4d460dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fac4d460ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fac4d461430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fac4d4614c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fac4d461670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fac4d461700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fac4d461820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fac4d4618b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fac4d461940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fac4d4619d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fac4d461c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fac4d461d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fac4d461b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fac4d461ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 39247
INFO root:portable_runner.py:543 starting data server on port 42883
INFO root:portable_runner.py:543 starting state server on port 42403
INFO root:portable_runner.py:543 starting logging server on port 45383
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c0df430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'042ed3e3d6fb015aca1be7752c95cb87b75982e8caa52698a1f22905799977da', worker_id = worker_60
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c1820d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'768504589d27c5f344e089708afaee0af9bff3c7fbdb06cf68acd61f0a4428ba', worker_id = worker_61
INFO root:portable_runner.py:543 Completed job in 15.282720565795898 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '53029' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:53029
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:39 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:40 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:41 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:44 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 25, 2023 5:33:46 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb6ef3ee3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb6ef3ee430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb6ef3eeb80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fac4d460dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fac4d460ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fac4d461430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fac4d4614c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fac4d461670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fac4d461700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fac4d461820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fac4d4618b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fac4d461940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fac4d4619d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fac4d461c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fac4d461d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fac4d461b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fac4d461ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 38605
INFO root:portable_runner.py:543 starting data server on port 38999
INFO root:portable_runner.py:543 starting state server on port 44661
INFO root:portable_runner.py:543 starting logging server on port 34047
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c166400> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e9b78be6299a296daf62d3c6ec41164c74a64c278952809ccbaab9a6c59cd4a2', worker_id = worker_62
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac7c661a90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'25b56ecc3e6124710f272b169b21f5ca11d9a27d12a0eb97ecdd80a89f7d8fbb', worker_id = worker_63
INFO root:portable_runner.py:543 Completed job in 15.42707085609436 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 263.45s (0:04:23) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2433598
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2434493.
Stopping expansion service pid: 2434494.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':release:go-licenses:go:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 23m 49s
257 actionable tasks: 169 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cactprsxzwoa2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4861
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4861/display/redirect?page=changes>
Changes:
[noreply] Revert "revert protobuf version (#29523)" (#29530)
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:30 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:30 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:30 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f72808a53a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f72808a5430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f72808a5b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff8152b8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff8152b8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff8152b9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff8152b94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff8152b9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff8152b9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff8152b9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff8152b98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff8152b9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff8152b99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff8152b9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff8152b9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff8152b9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff8152b9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 41115
INFO root:portable_runner.py:543 starting data server on port 39055
INFO root:portable_runner.py:543 starting state server on port 38653
INFO root:portable_runner.py:543 starting logging server on port 39157
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff848975040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c43408e5d78d16f1a586ce741397561cfbf603b5dce75155b4a3a38490ee005b', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff841c4cb80> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'39ec63ee34ff01573b03a99acafa8e9410132ad115432a027f7a50ededf4f2b6', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.095734119415283 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '59609' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:59609
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:56 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:57 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:57 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:57 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:59 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:37:01 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f72808a53a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f72808a5430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f72808a5b80> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff8152b8dc0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff8152b8ee0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff8152b9430> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff8152b94c0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff8152b9670> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff8152b9700> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff8152b9820> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff8152b98b0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff8152b9940> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff8152b99d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff8152b9c10> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff8152b9d30> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff8152b9b80> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff8152b9ca0> ====================
INFO root:portable_runner.py:543 starting control server on port 36259
INFO root:portable_runner.py:543 starting data server on port 44973
INFO root:portable_runner.py:543 starting state server on port 41987
INFO root:portable_runner.py:543 starting logging server on port 45619
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff84893bd00> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'd03e8a5cf8a07c4d01ece96c94bdd18c0b2a60fc91bdf763dbaa313130619433', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff841c772e0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f8986eb85d711795e1c0e96ae474010d50990a8cc15b0b01f6e68fa0240daec0', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.139945983886719 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 260.96s (0:04:20) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2159896
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2160385.
Stopping expansion service pid: 2160386.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 2s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wthjxeqdgcfvs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4860
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4860/display/redirect>
Changes:
------------------------------------------
[...truncated 1.51 MB...]
component_coder_ids: "NAgNzteutQTimestampedValueCoder"
>
>
coders: <
key: "NAgNzteutQKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "NAgNzteutQVarIntCoder"
component_coder_ids: "NAgNzteutQIterableCoder"
>
>
coders: <
key: "NAgNzteutQRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$a7c5de7e-7ebf-4f6d-91c3-52965679ffbe"
>
>
>
coders: <
key: "NAgNzteutQTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000Q\253`#sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\263\232\305\024u\007\337\003\n\233\014-\273<A\373\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "NAgNzteutQVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "NAgNzteutQVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "NAgNzteutQbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar\022@a2b20831e98dc7a75c21457117f7405a629cf6e0cbc116bf0954972d2976fcc5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/24 17:20:31 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700846431825437031
2023/11/24 17:20:34 Prepared job with id: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30 and staging token: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30
2023/11/24 17:20:34 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30
2023/11/24 17:20:34 Submitted job: go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30
2023/11/24 17:20:34 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: STOPPED
2023/11/24 17:20:34 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: STARTING
2023/11/24 17:20:34 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: RUNNING
2023/11/24 17:20:34 2023-11-24 17:20:34. (1): ==================== <function annotate_downstream_side_inputs at 0x7fda21b18ee0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fda21b19040> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (3): ==================== <function pack_combiners at 0x7fda21b19550> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (4): ==================== <function lift_combiners at 0x7fda21b195e0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (5): ==================== <function expand_sdf at 0x7fda21b19790> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (6): ==================== <function expand_gbk at 0x7fda21b19820> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (7): ==================== <function sink_flattens at 0x7fda21b19940> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (8): ==================== <function greedily_fuse at 0x7fda21b199d0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (9): ==================== <function read_to_impulse at 0x7fda21b19a60> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (10): ==================== <function impulse_to_input at 0x7fda21b19af0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (11): ==================== <function sort_stages at 0x7fda21b19d30> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fda21b19e50> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (13): ==================== <function setup_timer_mapping at 0x7fda21b19ca0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (14): ==================== <function populate_data_channel_coders at 0x7fda21b19dc0> ====================
2023/11/24 17:20:34 2023-11-24 17:20:34. (15): starting control server on port 33919
2023/11/24 17:20:34 2023-11-24 17:20:34. (16): starting data server on port 46157
2023/11/24 17:20:34 2023-11-24 17:20:34. (17): starting state server on port 35483
2023/11/24 17:20:34 2023-11-24 17:20:34. (18): starting logging server on port 40347
2023/11/24 17:20:34 2023-11-24 17:20:34. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fda564457c0> for environment NAgNzteutQbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/24 17:20:38 2023-11-24 17:20:38. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/24 17:20:39 2023-11-24 17:20:39. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/24 17:20:40 2023-11-24 17:20:40. (22): Waiting for docker to start up. Current status is running
2023/11/24 17:20:40 2023-11-24 17:20:40. (23): Docker container is running. container_id = b'42fa4221390591f8a81ee2d363ffb39a0353cecbdf35579a1f7eed9c9f153317', worker_id = worker_17
2023/11/24 17:20:41 2023-11-24 17:20:41. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fda559d78b0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/24 17:20:43 2023-11-24 17:20:43. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/24 17:20:44 2023-11-24 17:20:44. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/24 17:20:45 2023-11-24 17:20:45. (27): Waiting for docker to start up. Current status is running
2023/11/24 17:20:45 2023-11-24 17:20:45. (28): Docker container is running. container_id = b'a579924f5944e8877ff03e7ddb35612db95217321c3b865637083ec839192c7f', worker_id = worker_19
2023/11/24 17:20:48 2023-11-24 17:20:48. (29): Completed job in 14.266002178192139 seconds with state DONE.
2023/11/24 17:20:48 Job[go-testjdbcio_postgresreadwrite-840-686ef906-f616-47e1-94d9-f532aa073f30] state: DONE
2023/11/24 17:20:48 🐳 Terminating container: d14cb48fd7a5
2023/11/24 17:20:49 🚫 Container terminated: d14cb48fd7a5
--- PASS: TestJDBCIO_PostgresReadWrite (39.92s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 121.569s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43075
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpw4i9jsv1/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43573
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 57s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/4xefytnhemgl6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4859
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4859/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:17 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:17 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:18 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:19 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:20 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fafac7f74c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fafac7f7550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fafac7f7ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f272cf92ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f272cf93040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f272cf93550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f272cf935e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f272cf93790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f272cf93820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f272cf93940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f272cf939d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f272cf93a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f272cf93af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f272cf93d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f272cf93e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f272cf93ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f272cf93dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 35481
INFO root:portable_runner.py:543 starting data server on port 37313
INFO root:portable_runner.py:543 starting state server on port 36143
INFO root:portable_runner.py:543 starting logging server on port 33327
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f27618f9910> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3b8802857882a9dcf1a7ae0ac2c4a9f62d8a957f22b493817aa4fc944c7001ce', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2760dcb250> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cdaa4548d93d27483bac6faa78e7c5a02fb4cdc5e8084305082c81f96d873c6b', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.137111186981201 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '48165' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:48165
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:44 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:45 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:46 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:48 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 11:36:49 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fafac7f74c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fafac7f7550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fafac7f7ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f272cf92ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f272cf93040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f272cf93550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f272cf935e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f272cf93790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f272cf93820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f272cf93940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f272cf939d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f272cf93a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f272cf93af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f272cf93d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f272cf93e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f272cf93ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f272cf93dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 41097
INFO root:portable_runner.py:543 starting data server on port 37033
INFO root:portable_runner.py:543 starting state server on port 34355
INFO root:portable_runner.py:543 starting logging server on port 40131
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2760deeee0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'b2fc2fcaee92edf62052d8dccc6072ac1215892fe9df574134cd9dccae95dc10', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2760dab3d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fc574219cc4bb961358a5505e17117b90676c134218f4ca44eb99e5c47b3a625', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.566296100616455 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 258.05s (0:04:18) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1181724
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1182221.
Stopping expansion service pid: 1182222.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 26m 53s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/jtq6e5p4zzfdo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4858
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4858/display/redirect>
Changes:
------------------------------------------
[...truncated 1.59 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f656b3ef4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f656b3ef550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f656b3efca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd5d1304ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd5d1305040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd5d1305550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd5d13055e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd5d1305790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd5d1305820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd5d1305940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd5d13059d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd5d1305a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd5d1305af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd5d1305d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd5d1305e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd5d1305ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd5d1305dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 37091
INFO root:portable_runner.py:543 starting data server on port 45075
INFO root:portable_runner.py:543 starting state server on port 45355
INFO root:portable_runner.py:543 starting logging server on port 38675
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604d519d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2e0c55d3c7b1ca4f428bf4cd56a20b3abb9e818984d16fed84c3b97e0c227753', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604d49df0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'15aba96b7d635b55becb40cd03d59ebf8787fb954f44373d92484155a011e174', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 19.313004970550537 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '35943' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:35943
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:15 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 24, 2023 5:37:16 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f656b3ef4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f656b3ef550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f656b3efca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd5d1304ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd5d1305040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd5d1305550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd5d13055e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd5d1305790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd5d1305820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd5d1305940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd5d13059d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd5d1305a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd5d1305af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd5d1305d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd5d1305e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd5d1305ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd5d1305dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 34825
INFO root:portable_runner.py:543 starting data server on port 43733
INFO root:portable_runner.py:543 starting state server on port 39079
INFO root:portable_runner.py:543 starting logging server on port 34917
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604c60a90> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'31ddeb9e19e0a2b2604d4e1a9a2a1ad4a4381c0c452bc71c8d5051e17b29316f', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd604c65fa0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f037e5fa8dcea5d8cb9bf8d9771179c2aa8e4a8c1cf865fdefd7e01d863efd49', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.17776870727539 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 269.74s (0:04:29) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 721381
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 722314.
Stopping expansion service pid: 722315.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 21s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/u5lkwdshjhzu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4857
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4857/display/redirect>
Changes:
------------------------------------------
[...truncated 1.50 MB...]
key: "vdheYaGEDFIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "vdheYaGEDFTimestampedValueCoder"
>
>
coders: <
key: "vdheYaGEDFKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vdheYaGEDFVarIntCoder"
component_coder_ids: "vdheYaGEDFRowCoder"
>
>
coders: <
key: "vdheYaGEDFKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vdheYaGEDFVarIntCoder"
component_coder_ids: "vdheYaGEDFTimestampedValueCoder"
>
>
coders: <
key: "vdheYaGEDFKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "vdheYaGEDFVarIntCoder"
component_coder_ids: "vdheYaGEDFIterableCoder"
>
>
coders: <
key: "vdheYaGEDFRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$b565780b-d62a-4e12-83f5-e97023082b3f"
>
>
>
coders: <
key: "vdheYaGEDFTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000Q\253`#sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\271\215\273\014\237?#\027\210\212\034\306\r<A\201\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\000v\246\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "vdheYaGEDFVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "vdheYaGEDFVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "vdheYaGEDFbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar\022@a2b20831e98dc7a75c21457117f7405a629cf6e0cbc116bf0954972d2976fcc5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/23 23:20:27 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700781627375434833
2023/11/23 23:20:29 Prepared job with id: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487 and staging token: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487
2023/11/23 23:20:30 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487
2023/11/23 23:20:30 Submitted job: go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487
2023/11/23 23:20:30 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: STOPPED
2023/11/23 23:20:30 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: STARTING
2023/11/23 23:20:30 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: RUNNING
2023/11/23 23:20:30 2023-11-23 23:20:30. (1): ==================== <function annotate_downstream_side_inputs at 0x7f282e185ee0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f282e186040> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (3): ==================== <function pack_combiners at 0x7f282e186550> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (4): ==================== <function lift_combiners at 0x7f282e1865e0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (5): ==================== <function expand_sdf at 0x7f282e186790> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (6): ==================== <function expand_gbk at 0x7f282e186820> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (7): ==================== <function sink_flattens at 0x7f282e186940> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (8): ==================== <function greedily_fuse at 0x7f282e1869d0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (9): ==================== <function read_to_impulse at 0x7f282e186a60> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (10): ==================== <function impulse_to_input at 0x7f282e186af0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (11): ==================== <function sort_stages at 0x7f282e186d30> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f282e186e50> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (13): ==================== <function setup_timer_mapping at 0x7f282e186ca0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (14): ==================== <function populate_data_channel_coders at 0x7f282e186dc0> ====================
2023/11/23 23:20:30 2023-11-23 23:20:30. (15): starting control server on port 39943
2023/11/23 23:20:30 2023-11-23 23:20:30. (16): starting data server on port 41447
2023/11/23 23:20:30 2023-11-23 23:20:30. (17): starting state server on port 36177
2023/11/23 23:20:30 2023-11-23 23:20:30. (18): starting logging server on port 44705
2023/11/23 23:20:30 2023-11-23 23:20:30. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2862b5fa60> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/23 23:20:30 2023-11-23 23:20:30. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/23 23:20:30 2023-11-23 23:20:30. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/23 23:20:36 2023-11-23 23:20:36. (22): Waiting for docker to start up. Current status is running
2023/11/23 23:20:36 2023-11-23 23:20:36. (23): Docker container is running. container_id = b'236d6cbf592bf1798203d898ea2b600f444f87c54d98349442bac344180aba67', worker_id = worker_16
2023/11/23 23:20:38 2023-11-23 23:20:37. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2862a4b970> for environment vdheYaGEDFbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/23 23:20:40 2023-11-23 23:20:40. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/23 23:20:41 2023-11-23 23:20:41. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/23 23:20:42 2023-11-23 23:20:42. (27): Waiting for docker to start up. Current status is running
2023/11/23 23:20:42 2023-11-23 23:20:42. (28): Docker container is running. container_id = b'7fc21c220900d454d662c46ed43524396e726d8d74985f2c8969488643bdb04e', worker_id = worker_18
2023/11/23 23:20:48 2023-11-23 23:20:48. (29): Completed job in 18.33408522605896 seconds with state DONE.
2023/11/23 23:20:48 Job[go-testjdbcio_postgresreadwrite-288-302092b0-16b7-470e-aafd-71cfd8517487] state: DONE
2023/11/23 23:20:48 🐳 Terminating container: df0f23038c3f
2023/11/23 23:20:48 🚫 Container terminated: df0f23038c3f
--- PASS: TestJDBCIO_PostgresReadWrite (49.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 109.305s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33539
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpl0dms3x5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38731
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 18s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/x4we2cybk55fa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4856
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4856/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
component_coder_ids: "McrgpjzejnTimestampedValueCoder"
>
>
coders: <
key: "McrgpjzejnKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "McrgpjzejnVarIntCoder"
component_coder_ids: "McrgpjzejnIterableCoder"
>
>
coders: <
key: "McrgpjzejnRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$d9da51bc-0010-4ab0-a4cc-66c429331982"
>
>
>
coders: <
key: "McrgpjzejnTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\320*\277Bsr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\256\231\020\216\370\272\002~\t\361\260\252\343\"EN\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "McrgpjzejnVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "McrgpjzejnVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "Mcrgpjzejnbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar\022@a2b20831e98dc7a75c21457117f7405a629cf6e0cbc116bf0954972d2976fcc5"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-orIIMemNx6dcIUVxF_dAWmKc9uDLwRa_CVSXLSl2_MU.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/23 17:20:45 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700760045696698531
2023/11/23 17:20:48 Prepared job with id: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9 and staging token: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9
2023/11/23 17:20:48 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9
2023/11/23 17:20:48 Submitted job: go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9
2023/11/23 17:20:48 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: STOPPED
2023/11/23 17:20:48 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: STARTING
2023/11/23 17:20:48 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: RUNNING
2023/11/23 17:20:48 2023-11-23 17:20:48. (1): ==================== <function annotate_downstream_side_inputs at 0x7ff1a5eb1ee0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (2): ==================== <function fix_side_input_pcoll_coders at 0x7ff1a5eb3040> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (3): ==================== <function pack_combiners at 0x7ff1a5eb3550> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (4): ==================== <function lift_combiners at 0x7ff1a5eb35e0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (5): ==================== <function expand_sdf at 0x7ff1a5eb3790> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (6): ==================== <function expand_gbk at 0x7ff1a5eb3820> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (7): ==================== <function sink_flattens at 0x7ff1a5eb3940> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (8): ==================== <function greedily_fuse at 0x7ff1a5eb39d0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (9): ==================== <function read_to_impulse at 0x7ff1a5eb3a60> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (10): ==================== <function impulse_to_input at 0x7ff1a5eb3af0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (11): ==================== <function sort_stages at 0x7ff1a5eb3d30> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7ff1a5eb3e50> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (13): ==================== <function setup_timer_mapping at 0x7ff1a5eb3ca0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (14): ==================== <function populate_data_channel_coders at 0x7ff1a5eb3dc0> ====================
2023/11/23 17:20:48 2023-11-23 17:20:48. (15): starting control server on port 44937
2023/11/23 17:20:48 2023-11-23 17:20:48. (16): starting data server on port 42245
2023/11/23 17:20:48 2023-11-23 17:20:48. (17): starting state server on port 36665
2023/11/23 17:20:48 2023-11-23 17:20:48. (18): starting logging server on port 37021
2023/11/23 17:20:48 2023-11-23 17:20:48. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff1da8a50d0> for environment Mcrgpjzejnbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/23 17:20:52 2023-11-23 17:20:52. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/23 17:20:52 2023-11-23 17:20:52. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/23 17:20:53 2023-11-23 17:20:53. (22): Waiting for docker to start up. Current status is running
2023/11/23 17:20:53 2023-11-23 17:20:53. (23): Docker container is running. container_id = b'ee1a21ef8266dcdf3060ab2dff240fd41b451d2efce110dddfef5b3ebe6e7691', worker_id = worker_17
2023/11/23 17:20:54 2023-11-23 17:20:54. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff1a454d940> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/23 17:20:57 2023-11-23 17:20:57. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/23 17:20:57 2023-11-23 17:20:57. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/23 17:20:59 2023-11-23 17:20:59. (27): Waiting for docker to start up. Current status is running
2023/11/23 17:20:59 2023-11-23 17:20:59. (28): Docker container is running. container_id = b'5dc4b996a1f5989a20730e373d5e3c3d53dc670479129764a00b2c56e9faea4d', worker_id = worker_19
2023/11/23 17:21:02 2023-11-23 17:21:02. (29): Completed job in 14.0757315158844 seconds with state DONE.
2023/11/23 17:21:02 Job[go-testjdbcio_postgresreadwrite-282-e989bce1-d7a6-4c32-bcae-a2b3ca9182e9] state: DONE
2023/11/23 17:21:02 🐳 Terminating container: 17c0868aca2c
2023/11/23 17:21:02 🚫 Container terminated: 17c0868aca2c
--- PASS: TestJDBCIO_PostgresReadWrite (43.62s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 123.198s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.023s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36507
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpv8xz5yvp/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 37413
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 19s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/mm65xazecjfyy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4855
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4855/display/redirect>
Changes:
------------------------------------------
[...truncated 1.72 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:40 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:41 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:42 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:36:43 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f81ea77d4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f81ea77d550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f81ea77dca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff204d09ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff204d0a040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff204d0a550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff204d0a5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff204d0a790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff204d0a820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff204d0a940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff204d0a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff204d0aa60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff204d0aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff204d0ad30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff204d0ae50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff204d0aca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff204d0adc0> ====================
INFO root:portable_runner.py:543 starting control server on port 36889
INFO root:portable_runner.py:543 starting data server on port 46873
INFO root:portable_runner.py:543 starting state server on port 45627
INFO root:portable_runner.py:543 starting logging server on port 41309
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff23899d910> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0a09c57a3f0a533e2bd5cb66de8a495b129ccb4ef45606d30b37e1991e68a9c4', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff238e16cd0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8c25aa4e542b1c029a4331be70db1129f417456588c54eb6adcbecf49a553bf0', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 14.951537847518921 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '34159' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:34159
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:06 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:07 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:07 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:08 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:10 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 11:37:11 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f81ea77d4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f81ea77d550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f81ea77dca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff204d09ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff204d0a040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff204d0a550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff204d0a5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff204d0a790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff204d0a820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff204d0a940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff204d0a9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff204d0aa60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff204d0aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff204d0ad30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff204d0ae50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff204d0aca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff204d0adc0> ====================
INFO root:portable_runner.py:543 starting control server on port 45633
INFO root:portable_runner.py:543 starting data server on port 41845
INFO root:portable_runner.py:543 starting state server on port 44759
INFO root:portable_runner.py:543 starting logging server on port 38205
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff22c6f9670> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f6fb0c3daa31dd33473ae5a9a8d0b4e9b4813e6ad6313d8dd8f3f9feb8245671', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff2389c8430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3c3e82d4749240b6ec77c39dcb97ce58845e889775e67e8c7aab8b97f30973ab', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.224024534225464 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 255.55s (0:04:15) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3678450
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3682111.
Stopping expansion service pid: 3682112.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 11s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/tacodqbwvxd4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4854
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4854/display/redirect?page=changes>
Changes:
[noreply] revert protobuf version (#29523)
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:28 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:28 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:28 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:30 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:30 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:30 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6fc5b404c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6fc5b40550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6fc5b40ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4046f70ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4046f71040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4046f71550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4046f715e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4046f71790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4046f71820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4046f71940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4046f719d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4046f71a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4046f71af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4046f71d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4046f71e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4046f71ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4046f71dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 34607
INFO root:portable_runner.py:543 starting data server on port 37081
INFO root:portable_runner.py:543 starting state server on port 42547
INFO root:portable_runner.py:543 starting logging server on port 33463
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f406993e280> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7cd9a14db1ee5536dfc7e53c60179baa83228e499aab429a6e94245a63eda76d', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f407b5d4310> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'06f84c2c46aa76d641766c337d100f7f9b848309bde598be7d73f187c01dd6cc', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.59232497215271 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '60657' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:60657
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:55 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:56 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:56 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:56 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:37:58 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 23, 2023 5:38:00 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6fc5b404c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6fc5b40550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6fc5b40ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4046f70ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4046f71040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4046f71550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4046f715e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4046f71790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4046f71820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4046f71940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4046f719d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4046f71a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4046f71af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4046f71d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4046f71e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4046f71ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4046f71dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 40379
INFO root:portable_runner.py:543 starting data server on port 41167
INFO root:portable_runner.py:543 starting state server on port 35397
INFO root:portable_runner.py:543 starting logging server on port 33969
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f407b5a2dc0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'81074c72b749487d8dfad671d6adc1b2e5697fabf2b3ebf3a709e04753b1a802', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f407b5b3430> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'51c65c50bf26aec589fce53aae1ed1b5a370d4622df70aa86e80fb6308a10355', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 16.00628137588501 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 266.10s (0:04:26) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3325350
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3325910.
Stopping expansion service pid: 3325911.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 4s
261 actionable tasks: 177 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/u2kb25fcacn4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4853
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4853/display/redirect>
Changes:
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:43 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:36:45 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f00a55784c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f00a5578550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f00a5578ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f978f31dee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f978f31e040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f978f31e550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f978f31e5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f978f31e790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f978f31e820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f978f31e940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f978f31e9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f978f31ea60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f978f31eaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f978f31ed30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f978f31ee50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f978f31eca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f978f31edc0> ====================
INFO root:portable_runner.py:543 starting control server on port 39695
INFO root:portable_runner.py:543 starting data server on port 44899
INFO root:portable_runner.py:543 starting state server on port 34515
INFO root:portable_runner.py:543 starting logging server on port 45039
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c2cf8d60> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'508be959e1a376ca7d0ed6795b232410facd5d15974e78543eca91fe1e762cc8', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c2c914f0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0f38195ea8dcb4fb2796a40aeb55c921dc7aea59eb55713b7c25a8cc43ccffe5', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.07070016860962 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:249 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:119 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '46007' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Starting expansion service at localhost:46007
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:09 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:12 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 Nov 22, 2023 11:37:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:129
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f00a55784c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f00a5578550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f00a5578ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f978f31dee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f978f31e040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f978f31e550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f978f31e5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f978f31e790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f978f31e820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f978f31e940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f978f31e9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f978f31ea60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f978f31eaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f978f31ed30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f978f31ee50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f978f31eca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f978f31edc0> ====================
INFO root:portable_runner.py:543 starting control server on port 34805
INFO root:portable_runner.py:543 starting data server on port 43277
INFO root:portable_runner.py:543 starting state server on port 38511
INFO root:portable_runner.py:543 starting logging server on port 36687
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c255a0d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a051a83092ec8c16aca5cf430d988da1ff23326fae15caf3f1d645dc4f80a279', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f97c256c550> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'282b30deaf040eaefc320fb252eebce4f09d26e3e5eadd8eec1f06941f54d47f', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.265949010848999 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 253.78s (0:04:13) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3063144
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3063661.
Stopping expansion service pid: 3063662.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 17s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/47yuc6iikbapg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4852
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4852/display/redirect?page=changes>
Changes:
[noreply] Bump grpc_version dependency (#29511)
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:54 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:54 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:54 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:41:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0cd435b4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0cd435b550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0cd435bca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fecd3445ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fecd3446040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fecd3446550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fecd34465e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fecd3446790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fecd3446820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fecd3446940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fecd34469d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fecd3446a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fecd3446af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fecd3446d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fecd3446e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fecd3446ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fecd3446dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 40443
INFO root:portable_runner.py:543 starting data server on port 40553
INFO root:portable_runner.py:543 starting state server on port 45339
INFO root:portable_runner.py:543 starting logging server on port 37073
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fed06c5d340> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'3c4a85ef00026776fba1a4a887f79be5df33ed1972ade17ffd85ad8e5ba0d9d3', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fed06c4c970> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'99bd138c5672a877777ecc340867064b93141cc6a9e93c962fa8c030f3676ee3', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.158838272094727 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '57251' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:57251
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:20 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:21 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:21 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:23 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:42:25 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0cd435b4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0cd435b550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0cd435bca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fecd3445ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fecd3446040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fecd3446550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fecd34465e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fecd3446790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fecd3446820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fecd3446940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fecd34469d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fecd3446a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fecd3446af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fecd3446d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fecd3446e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fecd3446ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fecd3446dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 33123
INFO root:portable_runner.py:543 starting data server on port 46149
INFO root:portable_runner.py:543 starting state server on port 37049
INFO root:portable_runner.py:543 starting logging server on port 37643
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fecd0322700> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'bd727c25d290eb69afbae5d203dfe28867ca377439d68b8a727bff6d88b90f99', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fed06d55df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'570518015d8ce849dc43a22445aa5474ff40b2173c8a1f7671302dc534bfc3bc', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.534318923950195 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 294.28s (0:04:54) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1286195
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1300759.
Stopping expansion service pid: 1300760.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 32m 37s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/gykgrgsdzm5am
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4851
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4851/display/redirect>
Changes:
------------------------------------------
[...truncated 1.46 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:36 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:38 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:38 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:37:38 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f233a57f4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f233a57f550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f233a57fca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f7a16399ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f7a1639d040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f7a1639d550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f7a1639d5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f7a1639d790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f7a1639d820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f7a1639d940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f7a1639d9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f7a1639da60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f7a1639daf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f7a1639dd30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f7a1639de50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f7a1639dca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f7a1639ddc0> ====================
INFO root:portable_runner.py:543 starting control server on port 46587
INFO root:portable_runner.py:543 starting data server on port 36263
INFO root:portable_runner.py:543 starting state server on port 43279
INFO root:portable_runner.py:543 starting logging server on port 45111
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a4ac38c40> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'0ccd903eb59ff87a0e65495054df6543df72fee507ebfbe3b6c7b3de3436941d', worker_id = worker_83
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a4ac3bd60> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'dfc882d5cf4f111c56b37098397d8766bdd65f85c9ec1b61bcf20e2151d90b8d', worker_id = worker_84
INFO root:portable_runner.py:543 Completed job in 14.920599222183228 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '42251' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:42251
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:02 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:03 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:05 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 11:38:07 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f233a57f4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f233a57f550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f233a57fca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f7a16399ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f7a1639d040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f7a1639d550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f7a1639d5e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f7a1639d790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f7a1639d820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f7a1639d940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f7a1639d9d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f7a1639da60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f7a1639daf0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f7a1639dd30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f7a1639de50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f7a1639dca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f7a1639ddc0> ====================
INFO root:portable_runner.py:543 starting control server on port 43371
INFO root:portable_runner.py:543 starting data server on port 41747
INFO root:portable_runner.py:543 starting state server on port 44305
INFO root:portable_runner.py:543 starting logging server on port 43981
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a14211d00> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'ad1fce7dbfa5788d89b39648c7901357eb0d733d48e319b1dfd668eb0f877f76', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f7a4ad7f9d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'5abfc847fc6e82b3b1c8efc394960e2ca87e252f5676a7820e6f0ec228646d28', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.166422843933105 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 255.96s (0:04:15) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1084026
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1090899.
Stopping expansion service pid: 1090900.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 7s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/vy5owd7backmk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4850
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4850/display/redirect>
Changes:
------------------------------------------
[...truncated 1.71 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:31 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:33 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:33 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:33 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f3bfbf634c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f3bfbf63550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f3bfbf63ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4d462f2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4d462f3040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4d462f3550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4d462f35e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4d462f3790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4d462f3820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4d462f3940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4d462f39d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4d462f3a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4d462f3af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4d462f3d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4d462f3e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4d462f3ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4d462f3dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 43069
INFO root:portable_runner.py:543 starting data server on port 40301
INFO root:portable_runner.py:543 starting state server on port 34345
INFO root:portable_runner.py:543 starting logging server on port 42763
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d74d72b80> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'755d188741e9b0297083954f9b39407778318d05acdea42bed4a5e449594d61b', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d74d81760> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e0e918964c8fedec1fc00851961cb1cdbab81759d04b1b13a84922e054b22401', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.209623575210571 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '48401' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:48401
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:57 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:58 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:58 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:37:59 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:38:01 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 22, 2023 5:38:03 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f3bfbf634c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f3bfbf63550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f3bfbf63ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4d462f2ee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4d462f3040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4d462f3550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4d462f35e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4d462f3790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4d462f3820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4d462f3940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4d462f39d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4d462f3a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4d462f3af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4d462f3d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4d462f3e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4d462f3ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4d462f3dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 46311
INFO root:portable_runner.py:543 starting data server on port 36027
INFO root:portable_runner.py:543 starting state server on port 44245
INFO root:portable_runner.py:543 starting logging server on port 43869
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d754d5ac0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f63983d1b0836f8921adb5841138eb1722ee059473d6e3014bce3a5cd40b6c02', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4d74d7fa90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'db944a07d0231fb5e1803ce0407ead4dd53938f853a3de6e4c174401d51a0cc8', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.324472188949585 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 263.50s (0:04:23) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2173364
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2174350.
Stopping expansion service pid: 2174351.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 6s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/u3sxuy4ifmpd4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4849
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4849/display/redirect>
Changes:
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:44 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:45 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:45 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:47 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:47 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:37:47 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa3022e54c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa3022e5550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa3022e5ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4393d7cee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4393d80040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4393d80550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4393d805e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4393d80790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4393d80820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4393d80940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4393d809d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4393d80a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4393d80af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4393d80d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4393d80e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4393d80ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4393d80dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 35687
INFO root:portable_runner.py:543 starting data server on port 39621
INFO root:portable_runner.py:543 starting state server on port 43675
INFO root:portable_runner.py:543 starting logging server on port 43677
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c7f9cc40> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'9cc37708f451a5577660cc14636f0d7665400c02f42bd7e7982727c07b8ad7b4', worker_id = worker_85
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c86b7880> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'4d2ab1928f718505e03ae247c29ef6b8c8cbac553a57d349e7a0e583f30e0a69', worker_id = worker_86
INFO root:portable_runner.py:543 Completed job in 15.926170110702515 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:240 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO root:external.py:980 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:117 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar'> '36903' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.53.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Starting expansion service at localhost:36903
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:12 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@68267da0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@2638011
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6ff29830
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@6a2b953e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1541049864@313b2ea6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:13 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:15 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 Nov 21, 2023 11:38:17 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:127
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa3022e54c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa3022e5550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa3022e5ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4393d7cee0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4393d80040> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4393d80550> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4393d805e0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4393d80790> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4393d80820> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4393d80940> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4393d809d0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4393d80a60> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4393d80af0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4393d80d30> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4393d80e50> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4393d80ca0> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4393d80dc0> ====================
INFO root:portable_runner.py:543 starting control server on port 35731
INFO root:portable_runner.py:543 starting data server on port 34871
INFO root:portable_runner.py:543 starting state server on port 38865
INFO root:portable_runner.py:543 starting logging server on port 35385
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c867c9d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'92af847cb0a821701c14ce983598fecb4bccc3a3a6e0b97c37afc5a724f22658', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f43c774abb0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.53.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.53.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.53.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'2d6599ad38ca89bc5b98eb2441f1ad76b42c3136d31037165d0d2920fb70589f', worker_id = worker_88
INFO root:portable_runner.py:543 Completed job in 15.557689666748047 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to DONE
PASSED [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
========== 9 passed, 18 skipped, 7212 deselected in 257.78s (0:04:17) ==========
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1883594
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1884137.
Stopping expansion service pid: 1884138.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 11s
261 actionable tasks: 174 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/rynwhb6ogsuya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4848
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4848/display/redirect?page=changes>
Changes:
[noreply] Propagate correct boundedness when using multiple outputs (#29506)
------------------------------------------
[...truncated 1.19 MB...]
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "xGpNdeEnoMIterableCoder"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "xGpNdeEnoMTimestampedValueCoder"
>
>
coders: <
key: "xGpNdeEnoMKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "xGpNdeEnoMVarIntCoder"
component_coder_ids: "xGpNdeEnoMRowCoder"
>
>
coders: <
key: "xGpNdeEnoMKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "xGpNdeEnoMVarIntCoder"
component_coder_ids: "xGpNdeEnoMTimestampedValueCoder"
>
>
coders: <
key: "xGpNdeEnoMKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "xGpNdeEnoMVarIntCoder"
component_coder_ids: "xGpNdeEnoMIterableCoder"
>
>
coders: <
key: "xGpNdeEnoMRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$eabfbe9b-9905-4909-bd50-0caf7273adb4"
>
>
>
coders: <
key: "xGpNdeEnoMTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000GP\343Isr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\277\343X G\013\323\220\263\346\027/v\344F\215\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "xGpNdeEnoMVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "xGpNdeEnoMVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "xGpNdeEnoMbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar\022@61328e97dbd13bc44fdf177998efb0bc0216fd8bfd8f4c07c47b9d8665598d70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2023/11/21 17:23:14 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1700587394652766790
2023/11/21 17:23:17 Prepared job with id: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36 and staging token: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36
2023/11/21 17:23:17 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36
2023/11/21 17:23:17 Submitted job: go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36
2023/11/21 17:23:17 2023-11-21 17:23:17. (6): ==================== <function expand_gbk at 0x7f60eaf0a8b0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (7): ==================== <function sink_flattens at 0x7f60eaf0a9d0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (8): ==================== <function greedily_fuse at 0x7f60eaf0aa60> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (9): ==================== <function read_to_impulse at 0x7f60eaf0aaf0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (10): ==================== <function impulse_to_input at 0x7f60eaf0ab80> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (11): ==================== <function sort_stages at 0x7f60eaf0adc0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f60eaf0aee0> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (13): ==================== <function setup_timer_mapping at 0x7f60eaf0ad30> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (14): ==================== <function populate_data_channel_coders at 0x7f60eaf0ae50> ====================
2023/11/21 17:23:17 2023-11-21 17:23:17. (15): starting control server on port 35511
2023/11/21 17:23:17 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: STOPPED
2023/11/21 17:23:17 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: STARTING
2023/11/21 17:23:17 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: RUNNING
2023/11/21 17:23:17 2023-11-21 17:23:17. (16): starting data server on port 41911
2023/11/21 17:23:17 2023-11-21 17:23:17. (17): starting state server on port 33529
2023/11/21 17:23:17 2023-11-21 17:23:17. (18): starting logging server on port 37277
2023/11/21 17:23:17 2023-11-21 17:23:17. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f611e907e50> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/21 17:23:17 2023-11-21 17:23:17. (20): Attempting to pull image apache/beam_go_sdk:dev
2023/11/21 17:23:18 2023-11-21 17:23:18. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/21 17:23:24 2023-11-21 17:23:24. (22): Waiting for docker to start up. Current status is running
2023/11/21 17:23:24 2023-11-21 17:23:24. (23): Docker container is running. container_id = b'fbb3d06b38bc9b62d73fc5c8265889174b2d6e25d1103c1d3054336918c9e5be', worker_id = worker_14
2023/11/21 17:23:25 2023-11-21 17:23:25. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f611e899be0> for environment xGpNdeEnoMbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/21 17:23:28 2023-11-21 17:23:28. (25): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/21 17:23:28 2023-11-21 17:23:28. (26): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/21 17:23:29 2023-11-21 17:23:29. (27): Waiting for docker to start up. Current status is running
2023/11/21 17:23:29 2023-11-21 17:23:29. (28): Docker container is running. container_id = b'2e1535943c489487154294ae8f451d7f966b3a0d65a17cace606662c9c91bdfc', worker_id = worker_16
2023/11/21 17:23:36 2023-11-21 17:23:36. (29): Completed job in 18.324992656707764 seconds with state DONE.
2023/11/21 17:23:36 Job[go-testjdbcio_postgresreadwrite-741-0445cabf-43d2-4860-816e-a70ff7fd2c36] state: DONE
2023/11/21 17:23:36 🐳 Terminating container: 7fce9650c887
2023/11/21 17:23:36 🚫 Container terminated: 7fce9650c887
--- PASS: TestJDBCIO_PostgresReadWrite (55.07s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 156.415s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.024s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 46657
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpzbpe2b6x/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33463
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 31m 40s
261 actionable tasks: 176 executed, 75 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/yau7lz6jvrmze
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4847
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4847/display/redirect>
Changes:
------------------------------------------
[...truncated 1.37 MB...]
component_coder_ids: "SaPSArMhMbTimestampedValueCoder"
>
>
coders: <
key: "SaPSArMhMbKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "SaPSArMhMbVarIntCoder"
component_coder_ids: "SaPSArMhMbIterableCoder"
>
>
coders: <
key: "SaPSArMhMbRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$ffefa076-959f-4a4a-a2cd-912efcd15cba"
>
>
>
coders: <
key: "SaPSArMhMbTimestampedValueCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\006g\325\026\270\254\355\000\005sr\000Aorg.apache.beam.sdk.values.TimestampedV\001\022\000$>\021\000HCoder\364\376\202p\274iX-\002\000\001L\000\n\005;\005\030\034t\000\"Lorg/\t]\000/\001]\024/sdk/c\0015\004s/\005$\020;xr\000*N\202\000\t%(.Structured\005/8s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\005/\034C\335\325\211\256\274~\370\001/\020psr\000#j1\000\010Row\0054\034\254\236\213\244M\203\363\250\0014\010r\000'N2\000 schemas.S\005\010\0056|\023\226L\354\244P\260l\002\000\004L\000\017fromRowFunctiont\0005R\t\001Xtransforms/Serializable\0217\014;L\000\006\tk\010t\000$RA\000\t\036\004s/\t\211\024;L\000\rto\035x`q\000~\000\007L\000\016typeDescriptort\000+RM\000%\271\010s/T2-\000!\240\000&N\004\001-\240\024Custom%\003\034j\260\010\235\013;\035\013!9\001z\020\003sr\000=N;\000\031\367\000.N\367\000Ds$Identity\033n\367C9'S\320\001R!\277\000\"NN\000-\004-\215da\253Z\320H\204\232h\002\000\007Z\000\033encodingPosi!\211DsOverriddenI\000\010hash\001\272\010L\000\021B)\000\220t\000\017Ljava/util/Map;L\000\014fieldIndicest\000JL>\335\002 vendor/gu\0019Pv32_1_2_jre/com/googl\005\0134mon/collect/Bi\t\\\000\006\005\\\014st\000\020\035w$List;L\000\007op\005\275\010t\000,R\271\001-\002M\006\004$O\t.\034;L\000\004uuid6S\000<UUID;xp\000\216\005\353\353sr\000\021\001\344\000.\001\344\360I.HashMap\005\007\332\301\303\026`\321\003\000\002F\000\nloadFactorI\000\tthresholdxp?@\000\000\000\000\000\014w\010\000\000\000\020\000\000\000\001t\000\007role_id\025Wdlang.Integer\022\342\240\244\367\201\2078\002\000\001I\000\005Ek\014xr\000\020\005\177\005(4Number\206\254\225\035\013\224\340\213%\362\001b\014xsr\000\001\3652\242\004)h\000.%h\000.=h\020.com.)h\001\013\014mon.-h\005\336%l\001U\001\001(\003\000\000xpw\004\000\000\000\001A\255\000\027\001\005\000\032\001n\000\023\005\224%\023\020Array!\205 x\201\322\035\231\307a\235\003\001\276\024\004sizex\001I\000\001\t@\014sr\0002n\232\002\020AutoV\241?\000_i\250\004_FAH\034\303\343i\345\363l$\364\2052\004\013dm\237\000i\201.\000\022I\004!\030\030/String!\315\014name\001\246\000 Y\022\001\017(\022L\000\004typet\000.!)Bn\005:\036\002\005|a\344\020;xr\000(n\267\000\t\255\t1\034\263\021\225\3324!\217\246%\230\010t\000\000\001y\010\027srV\273\005\rr\021AM\220 \367\031\n\2336X\271\227\002\301&Q\323\001H\010\017xp\005\010\004\025?IU\014\000w\010\000IU%\376\0006n\244\000V[\001\001\33749\304m\364S\243\227P\002\000\010L\000\025M\007$ionElement\001#\001}(!L\000\013logical\001\023\010t\0000\216E\001\000L\0312$;L\000\nmapKey\001@\rS\014\014map%\362\035\024 \010metadata\001$\034\017L\000\010null\241\357\010t\000\023=\360\024Boolea\241\374\014\trow)\204\0012\014\010L\000\010!\347\030Namet\000-\216\246\000\001}\001/!\352\000,nF\001\tf)\352\0015\034\013PLl[\357\3103%\356\001\001\014sr\000\036y\027\000C\211\274Lions$EmptyMapY6\024\205Z\334\347\265\253\211YA\302\000.\r\322,\315 r\200\325\234\372\356\002\000\001Z\221\002\030p\000p~r\000+\212\234\000\001\227\001\314a\273\001\001\000\022\022\001\010\000\016\005\225\005f\014Enum\001\031\001\001\001\035$pt\000\005INT64xE]\000%\005\006Zc\002\tGe\363\210UUID\274\231\003\367\230m\205/\002\000\002J\000\014leastSigBitsJ\000\013mo\025\016Dxp\210b\347\026{\204d^\244~\033\334\341\332O\003\005e\010\014srVo\001\205\366\004s.\001\313\371\216(s$9z\2164\213\005/\271\347!o\010r\000)N\016\001R;\000 \022\210\327\037Z\244\342\260\002aR \005tokent\000NB\032\002\251.\222\226\006\014refl\301\226\001\243\000T\001P\000;\345x\000\\>\223\000\tS\222\201\005\rS\005\366\005S\024$Simple\032\005\020!\261\001\001\t\376\001\276\336\354\005Bk\000 2{#\261\276\3768|\002!!\030\013runtim\005y\010t\000\030}s\r8\005\366\030;xpvr\000\036>\361\000\000s&\024\013(Row\032Q\006\2060\230\247\034\005X4\006schemaq\000~\000\010xp"
>
>
>
coders: <
key: "SaPSArMhMbVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "SaPSArMhMbVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "SaPSArMhMbbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.53.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar\022@61328e97dbd13bc44fdf177998efb0bc0216fd8bfd8f4c07c47b9d8665598d70"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.53.0-SNAPSHOT-YTKOl9vRO8RP3xd5mO-wvAIW_Yv9j0wHxHudhmVZjXA.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.53.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2023/11/21 11:21:02 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1700565662969762051
2023/11/21 11:21:05 Prepared job with id: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa and staging token: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa
2023/11/21 11:21:06 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa
2023/11/21 11:21:06 Submitted job: go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa
2023/11/21 11:21:06 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: STOPPED
2023/11/21 11:21:06 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: STARTING
2023/11/21 11:21:06 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: RUNNING
2023/11/21 11:21:06 2023-11-21 11:21:06. (1): ==================== <function annotate_downstream_side_inputs at 0x7fac3b0b9f70> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fac3b0bb0d0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (3): ==================== <function pack_combiners at 0x7fac3b0bb5e0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (4): ==================== <function lift_combiners at 0x7fac3b0bb670> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (5): ==================== <function expand_sdf at 0x7fac3b0bb820> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (6): ==================== <function expand_gbk at 0x7fac3b0bb8b0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (7): ==================== <function sink_flattens at 0x7fac3b0bb9d0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (8): ==================== <function greedily_fuse at 0x7fac3b0bba60> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (9): ==================== <function read_to_impulse at 0x7fac3b0bbaf0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (10): ==================== <function impulse_to_input at 0x7fac3b0bbb80> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (11): ==================== <function sort_stages at 0x7fac3b0bbdc0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fac3b0bbee0> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (13): ==================== <function setup_timer_mapping at 0x7fac3b0bbd30> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (14): ==================== <function populate_data_channel_coders at 0x7fac3b0bbe50> ====================
2023/11/21 11:21:06 2023-11-21 11:21:06. (15): starting control server on port 41389
2023/11/21 11:21:06 2023-11-21 11:21:06. (16): starting data server on port 43769
2023/11/21 11:21:06 2023-11-21 11:21:06. (17): starting state server on port 46101
2023/11/21 11:21:06 2023-11-21 11:21:06. (18): starting logging server on port 34621
2023/11/21 11:21:06 2023-11-21 11:21:06. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac6ebcde80> for environment SaPSArMhMbbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.53.0.dev')
2023/11/21 11:21:06 2023-11-21 11:21:06. (20): Attempting to pull image apache/beam_java8_sdk:2.53.0.dev
2023/11/21 11:21:07 2023-11-21 11:21:07. (21): Unable to pull image apache/beam_java8_sdk:2.53.0.dev, defaulting to local image if it exists
2023/11/21 11:21:09 2023-11-21 11:21:09. (22): Waiting for docker to start up. Current status is running
2023/11/21 11:21:09 2023-11-21 11:21:09. (23): Docker container is running. container_id = b'7c8761f3495337e854d16edc94b0d6f250d88c7836a198baf39dd042cf5137fd', worker_id = worker_17
2023/11/21 11:21:10 2023-11-21 11:21:10. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fac6ebd4dc0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/11/21 11:21:13 2023-11-21 11:21:13. (25): Attempting to pull image apache/beam_go_sdk:dev
2023/11/21 11:21:13 2023-11-21 11:21:13. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/11/21 11:21:15 2023-11-21 11:21:15. (27): Waiting for docker to start up. Current status is running
2023/11/21 11:21:15 2023-11-21 11:21:15. (28): Docker container is running. container_id = b'03fa67654c75d77b256cb1e0d0670933163d05c112ec59cc52c6d77b13c795ba', worker_id = worker_19
2023/11/21 11:21:18 2023-11-21 11:21:18. (29): Completed job in 12.29131531715393 seconds with state DONE.
2023/11/21 11:21:18 Job[go-testjdbcio_postgresreadwrite-180-65d67a11-8f59-47db-ad12-27bbc7b4d4fa] state: DONE
2023/11/21 11:21:18 🐳 Terminating container: 4b1717ccf670
2023/11/21 11:21:18 🚫 Container terminated: 4b1717ccf670
--- PASS: TestJDBCIO_PostgresReadWrite (37.99s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 122.502s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:357: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.025s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36383
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.52.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpsiysleot/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44733
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 27m 46s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/zspelfnnt723a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org