You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/01/23 12:42:21 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3661
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3661/display/redirect>
Changes:
------------------------------------------
[...truncated 2.41 MB...]
INFO root:portable_runner.py:574 Docker container is running. container_id = b'0744b80a0531741b598ee3f73ad1842c4288d04c81a6db5aa5762288ae601f22', worker_id = worker_84
INFO root:portable_runner.py:574 Completed job in 11.504099369049072 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:847 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '37337' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:37337
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:24 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:25 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:27 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:27 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:27 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.10_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe3db88dea0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe3db88df30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe3db88e680> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f4ed8219bd0> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f4ed8219cf0> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f4ed821a200> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f4ed821a290> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f4ed821a440> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f4ed821a4d0> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f4ed821a5f0> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f4ed821a680> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f4ed821a710> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f4ed821a7a0> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f4ed821a9e0> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f4ed821ab00> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f4ed821a950> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f4ed821aa70> ====================
INFO root:portable_runner.py:574 starting control server on port 44045
INFO root:portable_runner.py:574 starting data server on port 41781
INFO root:portable_runner.py:574 starting state server on port 39045
INFO root:portable_runner.py:574 starting logging server on port 43109
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4eb86d93c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.10_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'0b9beb2adb4fd9383bd1f011d0b8540abcaa6db80279106cdb869bda90db070e', worker_id = worker_85
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4eb86d9630> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'ad201f4d1576f5e7958a8f08693538e6c3e67a0373913fda000b4c3be59ee60f', worker_id = worker_86
INFO root:portable_runner.py:574 Completed job in 11.295013904571533 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:847 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '33899' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:33899
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:47 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:48 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:48 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:49 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:51 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 12:41:52 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.10_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe3db88dea0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe3db88df30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe3db88e680> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f4ed8219bd0> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f4ed8219cf0> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f4ed821a200> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f4ed821a290> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f4ed821a440> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f4ed821a4d0> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f4ed821a5f0> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f4ed821a680> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f4ed821a710> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f4ed821a7a0> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f4ed821a9e0> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f4ed821ab00> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f4ed821a950> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f4ed821aa70> ====================
INFO root:portable_runner.py:574 starting control server on port 43955
INFO root:portable_runner.py:574 starting data server on port 37355
INFO root:portable_runner.py:574 starting state server on port 35129
INFO root:portable_runner.py:574 starting logging server on port 43845
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4eb86bf1c0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'd872a8831e08440dde895640f881a04a73b07e20bd59564a45384b79c8ec5ade', worker_id = worker_87
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4eb8667880> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.10_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'e2fcf2bd9fd759dbfde2a857dd9eb892b318ed05ef8bd37ec617a30826978694', worker_id = worker_88
INFO root:portable_runner.py:574 Completed job in 15.436124086380005 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 6 skipped, 6799 deselected, 6 warnings in 239.39s (0:03:59) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 493036
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 495917.
Stopping expansion service pid: 495918.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 48m 34s
233 actionable tasks: 32 executed, 201 up-to-date
Publishing build scan...
https://gradle.com/s/qhshpxaehs4lo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #3666
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3666/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3665
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3665/display/redirect>
Changes:
------------------------------------------
[...truncated 2.70 MB...]
INFO root:portable_runner.py:574 Docker container is running. container_id = b'448b91abb1a92a3279c20d441aa883630ac2dffb5b7f2aba48a0ce7e6fe0c9d7', worker_id = worker_84
INFO root:portable_runner.py:574 Completed job in 12.21931529045105 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:847 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '38387' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:38387
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:21 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:22 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:23 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:23 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:25 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:25 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:25 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.10_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f3ac5162200> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f3ac5162290> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f3ac51629e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7fa607919bd0> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7fa607919cf0> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7fa60791a200> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7fa60791a290> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7fa60791a440> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7fa60791a4d0> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7fa60791a5f0> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7fa60791a680> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7fa60791a710> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7fa60791a7a0> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7fa60791a9e0> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7fa60791ab00> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7fa60791a950> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7fa60791aa70> ====================
INFO root:portable_runner.py:574 starting control server on port 41911
INFO root:portable_runner.py:574 starting data server on port 42657
INFO root:portable_runner.py:574 starting state server on port 39437
INFO root:portable_runner.py:574 starting logging server on port 39507
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa5e85bd270> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.10_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'ae42719318bf7799fbd84a02e8a07bff929ac34e7fcc8ebd1a614f28e12adb4d', worker_id = worker_85
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa5e85bd360> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'e7335a8d016025c3c8bdad9c3632894ece4b43f780a576d879cadf98864501b1', worker_id = worker_86
INFO root:portable_runner.py:574 Completed job in 12.303744077682495 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:847 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '34843' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:34843
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:46 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:47 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:47 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:48 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:50 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:45:51 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.10_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f3ac5162200> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f3ac5162290> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f3ac51629e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7fa607919bd0> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7fa607919cf0> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7fa60791a200> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7fa60791a290> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7fa60791a440> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7fa60791a4d0> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7fa60791a5f0> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7fa60791a680> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7fa60791a710> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7fa60791a7a0> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7fa60791a9e0> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7fa60791ab00> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7fa60791a950> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7fa60791aa70> ====================
INFO root:portable_runner.py:574 starting control server on port 46643
INFO root:portable_runner.py:574 starting data server on port 44767
INFO root:portable_runner.py:574 starting state server on port 38813
INFO root:portable_runner.py:574 starting logging server on port 34111
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa5e859cc70> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'4869ce0fcbb179adad2c07c647427b36faba4730c0cad751579f11b35edf4f12', worker_id = worker_87
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa5e8549300> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.10_sdk:2.46.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.10_sdk:2.46.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'daa59ad4420e3b603c3a2bc7c21194b6fb44aa03cba4786e6a6dafd4add5aa8a', worker_id = worker_88
INFO root:portable_runner.py:574 Completed job in 16.44105291366577 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 6 skipped, 6800 deselected, 6 warnings in 235.61s (0:03:55) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 452880
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 455786.
Stopping expansion service pid: 455787.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 51m 32s
233 actionable tasks: 32 executed, 201 up-to-date
Publishing build scan...
https://gradle.com/s/qaai5yeyqwpiu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3664
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3664/display/redirect?page=changes>
Changes:
[noreply] #20812 handle @RequiresStableInput in portable flink (#22889)
------------------------------------------
[...truncated 1021.94 KB...]
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fd0e5e5ac20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fd0e5e5ad40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fd0e5e5ab90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fd0e5e5acb0> ====================
INFO root:portable_runner.py:577 starting control server on port 40027
INFO root:portable_runner.py:577 starting data server on port 40287
INFO root:portable_runner.py:577 starting state server on port 35771
INFO root:portable_runner.py:577 starting logging server on port 34027
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd0c0858fd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'e74f02633c1666a6fb94ccbeaed3b0026048fdde1d256a2c406ccd29b9886646', worker_id = worker_81
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd0c089f1d0> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'7c8e7eb559cb8c824e3c9e08b0a365d59f4161b7ed3e96adc039042fb8d630b1', worker_id = worker_82
INFO root:portable_runner.py:577 Completed job in 17.991363525390625 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '59589' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:59589
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:48 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:50 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:53:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f49835d0b90> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f49835d0c20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f49835d13b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fd0e5e56dd0> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fd0e5e56ef0> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fd0e5e5a440> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fd0e5e5a4d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fd0e5e5a680> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fd0e5e5a710> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fd0e5e5a830> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fd0e5e5a8c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fd0e5e5a950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fd0e5e5a9e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fd0e5e5ac20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fd0e5e5ad40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fd0e5e5ab90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fd0e5e5acb0> ====================
INFO root:portable_runner.py:577 starting control server on port 43959
INFO root:portable_runner.py:577 starting data server on port 40451
INFO root:portable_runner.py:577 starting state server on port 39947
INFO root:portable_runner.py:577 starting logging server on port 37283
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd0c0980450> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'dec67e2bb4d827e74fab32f36b174e6ed96f339b584805e86d878b742df439bb', worker_id = worker_83
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd0c083b5d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'ddeaacc00b18a47a3c6ee0cf00d3f2016dde4342fc03786711de0f66b711616d', worker_id = worker_84
INFO root:portable_runner.py:577 Completed job in 17.20445680618286 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '51049' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:51049
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:54:18 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:54:19 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:54:19 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:54:20 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:54:22 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 5:54:23 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f49835d0b90> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f49835d0c20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f49835d13b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fd0e5e56dd0> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fd0e5e56ef0> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fd0e5e5a440> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fd0e5e5a4d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fd0e5e5a680> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fd0e5e5a710> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fd0e5e5a830> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fd0e5e5a8c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fd0e5e5a950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fd0e5e5a9e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fd0e5e5ac20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fd0e5e5ad40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fd0e5e5ab90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fd0e5e5acb0> ====================
INFO root:portable_runner.py:577 starting control server on port 45017
INFO root:portable_runner.py:577 starting data server on port 44977
INFO root:portable_runner.py:577 starting state server on port 34719
INFO root:portable_runner.py:577 starting logging server on port 45365
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd0c03b0b90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'ce33dc437e93c4e84aaedc0368713abe1b52dedf117ac9353624ec62d040e054', worker_id = worker_85
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd0e44b1490> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'0337b3dec7ea8c049f330b1c905de721beb5d4f2333ddb225e0013c00ac53cf4', worker_id = worker_86
INFO root:portable_runner.py:577 Completed job in 20.63269352912903 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6800 deselected, 1 warning in 356.79s (0:05:56) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2382835
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2395988.
Stopping expansion service pid: 2395989.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 44m 26s
248 actionable tasks: 167 executed, 69 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/6cjwnrwjsql3o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3663
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3663/display/redirect?page=changes>
Changes:
[Kiley Sok] Remove kileys from Java reviewers
[noreply] Fix Python PreCommit dependency compatibility test not run or redundant
[noreply] Move CombineValues override to non portable overrides (#25106)
[noreply] Exclude UsesMultimapState in Samza validatesPortableRunner tests
[noreply] Add GraalSystems (#23651)
[noreply] Bump timeout for default transient expansion service (#25111)
------------------------------------------
[...truncated 1.47 MB...]
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f4b208638c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f4b20863950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f4b208639e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f4b20863c20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f4b20863d40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f4b20863b90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f4b20863cb0> ====================
INFO root:portable_runner.py:577 starting control server on port 38869
INFO root:portable_runner.py:577 starting data server on port 40527
INFO root:portable_runner.py:577 starting state server on port 33533
INFO root:portable_runner.py:577 starting logging server on port 46733
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4b19fce290> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'ab8b04b66898552ef318b5afa949adbc7ff6d27cf8a64ffdea57ebdd501ce7ef', worker_id = worker_83
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4b1a184310> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'bc7293bcb36602dfc8b960d68c01baf9d0902ad19458b077cbaef0f0fe8f14af', worker_id = worker_84
INFO root:portable_runner.py:577 Completed job in 12.184616088867188 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '45105' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:45105
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:38 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:39 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:05:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f6f35e4cc20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f6f35e4ccb0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f6f35e4d440> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f4b2085edd0> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f4b2085eef0> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f4b20863440> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f4b208634d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f4b20863680> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f4b20863710> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f4b20863830> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f4b208638c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f4b20863950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f4b208639e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f4b20863c20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f4b20863d40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f4b20863b90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f4b20863cb0> ====================
INFO root:portable_runner.py:577 starting control server on port 39293
INFO root:portable_runner.py:577 starting data server on port 37453
INFO root:portable_runner.py:577 starting state server on port 44323
INFO root:portable_runner.py:577 starting logging server on port 40575
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4b1a1d0c90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'2305fbbe814cbd77b1e1da9b73b7e9e5b91081f8430a082a719954cef76c7545', worker_id = worker_85
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4b1a6a1f10> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'281305e45ce1d13966b9746689e33ca17810cbe68eea01336fbcd15af1e65af9', worker_id = worker_86
INFO root:portable_runner.py:577 Completed job in 12.640851974487305 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '53947' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:53947
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:06:03 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:06:04 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:06:04 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:06:04 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:06:06 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 24, 2023 12:06:08 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f6f35e4cc20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f6f35e4ccb0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f6f35e4d440> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f4b2085edd0> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f4b2085eef0> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f4b20863440> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f4b208634d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f4b20863680> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f4b20863710> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f4b20863830> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f4b208638c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f4b20863950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f4b208639e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f4b20863c20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f4b20863d40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f4b20863b90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f4b20863cb0> ====================
INFO root:portable_runner.py:577 starting control server on port 35235
INFO root:portable_runner.py:577 starting data server on port 38047
INFO root:portable_runner.py:577 starting state server on port 41001
INFO root:portable_runner.py:577 starting logging server on port 43263
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4b1a184050> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'd33123d3efa8775e3a79cc716617aa93203ec0a39d299c60e757f5d74366f50e', worker_id = worker_87
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4b19ff2710> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'3a3020c290c298c5843b457d78620923436c4d8737bc72c3ffb523a38ee1067c', worker_id = worker_88
INFO root:portable_runner.py:577 Completed job in 16.683722496032715 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6800 deselected, 1 warning in 244.92s (0:04:04) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2255664
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2319634.
Stopping expansion service pid: 2319635.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 56m 7s
248 actionable tasks: 163 executed, 73 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/jfjhvqgaosyi6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3662
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3662/display/redirect?page=changes>
Changes:
[noreply] Add I/O Standards Page (#24962)
[noreply] Add more info in documentation (#25099)
------------------------------------------
[...truncated 1.47 MB...]
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f830ff608c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f830ff60950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f830ff609e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f830ff60c20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f830ff60d40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f830ff60b90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f830ff60cb0> ====================
INFO root:portable_runner.py:577 starting control server on port 38881
INFO root:portable_runner.py:577 starting data server on port 38879
INFO root:portable_runner.py:577 starting state server on port 37285
INFO root:portable_runner.py:577 starting logging server on port 44277
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f830d76b7d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'aebd3077c5711337312f720fe71d6e521238952108fb1291ea684303c7ae555b', worker_id = worker_83
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f830dad8110> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'be25f7b630866b7d60480f794c1b20cbde1622bc721b927ba46a6946afe2dd96', worker_id = worker_84
INFO root:portable_runner.py:577 Completed job in 13.759222507476807 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '42601' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:42601
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:15 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:16 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:16 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:16 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:18 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:18 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:18 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7ff4c53ceb90> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7ff4c53cec20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7ff4c53cf3b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f830ff5bdd0> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f830ff5bef0> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f830ff60440> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f830ff604d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f830ff60680> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f830ff60710> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f830ff60830> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f830ff608c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f830ff60950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f830ff609e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f830ff60c20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f830ff60d40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f830ff60b90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f830ff60cb0> ====================
INFO root:portable_runner.py:577 starting control server on port 46767
INFO root:portable_runner.py:577 starting data server on port 44519
INFO root:portable_runner.py:577 starting state server on port 40037
INFO root:portable_runner.py:577 starting logging server on port 46323
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f830dad4390> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'49471ebc6cbee21d3a2f045abc36e6b860048bbfbaa1fcd970744d6495f2c507', worker_id = worker_85
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f830da71990> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'70cbd977b2af178b3db03fa7dab45e130fe8de35c71e4e5e0b6fc591b2b65c9e', worker_id = worker_86
INFO root:portable_runner.py:577 Completed job in 13.563274145126343 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '48743' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:48743
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:40 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:41 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:44 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 23, 2023 5:40:46 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7ff4c53ceb90> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7ff4c53cec20> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7ff4c53cf3b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f830ff5bdd0> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f830ff5bef0> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f830ff60440> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f830ff604d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f830ff60680> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f830ff60710> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f830ff60830> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f830ff608c0> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f830ff60950> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f830ff609e0> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f830ff60c20> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f830ff60d40> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f830ff60b90> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f830ff60cb0> ====================
INFO root:portable_runner.py:577 starting control server on port 34141
INFO root:portable_runner.py:577 starting data server on port 40001
INFO root:portable_runner.py:577 starting state server on port 34651
INFO root:portable_runner.py:577 starting logging server on port 41089
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f830d785310> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'5471039c77ecb737f3f9bbd7d4d9bf7339b5b4c80b06f97f84c1fb07314f4f89', worker_id = worker_87
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f830dbd2c10> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'2529f1d72b33e1fe43f8e8a6e569b97256e436b6d307add76754c1d39641b3f4', worker_id = worker_88
INFO root:portable_runner.py:577 Completed job in 16.033838510513306 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6799 deselected, 1 warning in 245.37s (0:04:05) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 499534
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 506146.
Stopping expansion service pid: 506147.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 30m 41s
248 actionable tasks: 172 executed, 64 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/y75e3vjbcgkmy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org