You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/01/17 17:59:43 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3638
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3638/display/redirect?page=changes>
Changes:
[piyush.sagar] BEAM-13261 added max connections setting
[piyush.sagar] BEAM-13261 updated comment for max connection
[noreply] Fix incorrect parsing of None value parameters. (#24948)
[noreply] Fix PipelineOptionTest.test_display_data (#25007)
[noreply] Fix Spark runner dependency (#25040)
[noreply] Bump future from 0.18.2 to 0.18.3 in /sdks/python/container/py39
[noreply] Bump torch (#24944)
------------------------------------------
[...truncated 1.17 MB...]
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f91420060e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f9142005ef0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f9142006050> ====================
INFO root:portable_runner.py:577 starting control server on port 42639
INFO root:portable_runner.py:577 starting data server on port 35649
INFO root:portable_runner.py:577 starting state server on port 40127
INFO root:portable_runner.py:577 starting logging server on port 37597
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9128376210> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'0f6f459bd260ca9bc68d15b26b9ed3201ecccad3ecaecfe3bb51a183dc188537', worker_id = worker_75
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9140702ad0> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'43339fa9adeda929b13d328021edbb4cf6896a7e3975efe52c6e497fc0c132d4', worker_id = worker_76
INFO root:portable_runner.py:577 Completed job in 12.722929954528809 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '52481' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:52481
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:36 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:37 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:37 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:38 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:40 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:58:40 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7ffb6ccb9f80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7ffb6ccba050> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7ffb6ccba7a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f9142005170> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f9142005290> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f91420057a0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f9142005830> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f91420059e0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f9142005a70> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f9142005b90> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f9142005c20> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f9142005cb0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f9142005d40> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f9142005f80> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f91420060e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f9142005ef0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f9142006050> ====================
INFO root:portable_runner.py:577 starting control server on port 44427
INFO root:portable_runner.py:577 starting data server on port 45113
INFO root:portable_runner.py:577 starting state server on port 45403
INFO root:portable_runner.py:577 starting logging server on port 32839
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f912835e2d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'7f16f118603679779910ce59a0bd53fc8dd406deb5ca852c2a6aaf9967e8fc70', worker_id = worker_77
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9140630690> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'12ba97755b48be74b73b8912adf946d310d1a00eadc8dc55546abf562d5b11b0', worker_id = worker_78
INFO root:portable_runner.py:577 Completed job in 13.42139458656311 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '57327' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:57327
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:59:03 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:57327.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:59:07 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:59:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:59:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:59:09 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 5:59:11 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7ffb6ccb9f80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7ffb6ccba050> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7ffb6ccba7a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f9142005170> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f9142005290> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f91420057a0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f9142005830> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f91420059e0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f9142005a70> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f9142005b90> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f9142005c20> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f9142005cb0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f9142005d40> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f9142005f80> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f91420060e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f9142005ef0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f9142006050> ====================
INFO root:portable_runner.py:577 starting control server on port 35585
INFO root:portable_runner.py:577 starting data server on port 33393
INFO root:portable_runner.py:577 starting state server on port 35649
INFO root:portable_runner.py:577 starting logging server on port 41079
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f91283e1d50> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'0983d9fa9e77d0d805aeefa1ea6e7b155426d9ab24601f954d0e70cabe07984e', worker_id = worker_79
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f912820a8d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'cb395c0c19f818293f1e609115dd015269e24c6907f3011102f1fc4999d143ac', worker_id = worker_80
INFO root:portable_runner.py:577 Completed job in 17.005097150802612 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6789 deselected, 1 warning in 246.67s (0:04:06) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 785389
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 791448.
Stopping expansion service pid: 791449.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 48m 41s
248 actionable tasks: 175 executed, 61 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ek4lwmztciylw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #3644
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3644/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3643
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3643/display/redirect?page=changes>
Changes:
[noreply] Remove trailing whitespace from blog to fix precommit (#25055)
[noreply] improve some errors from DoFnSignature (#25001)
[noreply] Bump torch (#24977)
[noreply] Set maxConnections optional in incoming schema for JdbcSchemaIOProvider
[noreply] Document that yield and return shouldn't be mixed. (#25060)
------------------------------------------
[...truncated 2.27 MB...]
>
>
>
coders: <
key: "PEksABrvoTVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\330\001\350\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xrr5\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*jj\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "PEksABrvoTVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\210\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\024Atomic\0055 \307\354\265\314\205tPF\002\0055\000*j5\000$Structured\0059\034s\277\022\016\325\3246\021\t9\000 j9\000\005/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "PEksABrvoTbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.46.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.46.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nL/tmp/artifacts/icedtea-sound-5xFkOD7aUmX8Jiw7lPqhn75zkNGCyUOfOuqi2rClWKM.jar\022@e71164383eda5265fc262c3b94faa19fbe7390d182c9439f3aeaa2dab0a558a3"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n=icedtea-sound-5xFkOD7aUmX8Jiw7lPqhn75zkNGCyUOfOuqi2rClWKM.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/jaccess-Rlp7GfuSFOBCBGdO8af2XxrTz5LqaQqwSMAXumdbHN0.jar\022@465a7b19fb9214e04204674ef1a7f65f1ad3cf92ea690ab048c017ba675b1cdd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7jaccess-Rlp7GfuSFOBCBGdO8af2XxrTz5LqaQqwSMAXumdbHN0.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nI/tmp/artifacts/localedata-Nuzln2shadVmT-PppqaNc7GHBbUyMUb9pXsJTjRiAzs.jar\022@36ece59f6b2169d5664fe3e9a6a68d73b18705b5323146fda57b094e3462033b"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n:localedata-Nuzln2shadVmT-PppqaNc7GHBbUyMUb9pXsJTjRiAzs.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nF/tmp/artifacts/nashorn-1iQRhJvU2nRCSB4ucg6f4b69TGiwE1yq0_LGG2MU5N0.jar\022@d62411849bd4da7442481e2e720e9fe1bebd4c68b0135caad3f2c61b6314e4dd"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n7nashorn-1iQRhJvU2nRCSB4ucg6f4b69TGiwE1yq0_LGG2MU5N0.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nG/tmp/artifacts/cldrdata-MTK3mMuUzlWYlYkweGQNzI7dFpuLG0_8F8oxT0khQDc.jar\022@3132b798cb94ce559895893078640dcc8edd169b8b1b4ffc17ca314f49214037"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n8cldrdata-MTK3mMuUzlWYlYkweGQNzI7dFpuLG0_8F8oxT0khQDc.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\nD/tmp/artifacts/dnsns-YTF3f6B-OG4FmXLRf2ckHBi4VJnspBZTyIQCz-6Spwk.jar\022@6131777fa07e386e059972d17f67241c18b85499eca41653c88402cfee92a709"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n5dnsns-YTF3f6B-OG4FmXLRf2ckHBi4VJnspBZTyIQCz-6Spwk.jar"
>
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.46.0-SNAPSHOT-UiuxCdWVzMTbiRG5cjf-UYAnAbQ7CDZ-yhSw7_hmDCA.jar\022@522bb109d595ccc4db8911b97237fe51802701b43b08367eca14b0eff8660c20"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.46.0-SNAPSHOT-UiuxCdWVzMTbiRG5cjf-UYAnAbQ7CDZ-yhSw7_hmDCA.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.46.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2023/01/19 00:02:17 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> as /tmp/worker-4-1674086537046792342
2023/01/19 00:02:24 Prepared job with id: go-testjdbcio_postgresreadwrite-217-5991d997-4971-4b60-b487-798039aa4841 and staging token: go-testjdbcio_postgresreadwrite-217-5991d997-4971-4b60-b487-798039aa4841
2023/01/19 00:02:25 Staged binary artifact with token:
2023/01/19 00:02:25 Submitted job: go-testjdbcio_postgresreadwrite-217-5991d997-4971-4b60-b487-798039aa4841
2023/01/19 00:02:25 2023-01-19 00:02:25. (1): Default Python SDK image for environment is apache/beam_python3.10_sdk:2.46.0.dev
2023/01/19 00:02:25 Job state: STOPPED
2023/01/19 00:02:25 Job state: STARTING
2023/01/19 00:02:25 Job state: RUNNING
2023/01/19 00:02:25 2023-01-19 00:02:25. (2): ==================== <function annotate_downstream_side_inputs at 0x7fc918518820> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (3): ==================== <function fix_side_input_pcoll_coders at 0x7fc918518940> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (4): ==================== <function pack_combiners at 0x7fc918518e50> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (5): ==================== <function lift_combiners at 0x7fc918518ee0> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (6): ==================== <function expand_sdf at 0x7fc918519090> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (7): ==================== <function expand_gbk at 0x7fc918519120> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (8): ==================== <function sink_flattens at 0x7fc918519240> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (9): ==================== <function greedily_fuse at 0x7fc9185192d0> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (10): ==================== <function read_to_impulse at 0x7fc918519360> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (11): ==================== <function impulse_to_input at 0x7fc9185193f0> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (12): ==================== <function sort_stages at 0x7fc918519630> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (13): ==================== <function add_impulse_to_dangling_transforms at 0x7fc918519750> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (14): ==================== <function setup_timer_mapping at 0x7fc9185195a0> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (15): ==================== <function populate_data_channel_coders at 0x7fc9185196c0> ====================
2023/01/19 00:02:25 2023-01-19 00:02:25. (16): starting control server on port 41957
2023/01/19 00:02:25 2023-01-19 00:02:25. (17): starting data server on port 40933
2023/01/19 00:02:25 2023-01-19 00:02:25. (18): starting state server on port 38565
2023/01/19 00:02:25 2023-01-19 00:02:25. (19): starting logging server on port 34307
2023/01/19 00:02:25 2023-01-19 00:02:25. (20): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc91833b8b0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/01/19 00:02:25 2023-01-19 00:02:25. (21): Attempting to pull image apache/beam_go_sdk:dev
2023/01/19 00:02:26 2023-01-19 00:02:26. (22): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/01/19 00:02:30 2023-01-19 00:02:30. (23): Waiting for docker to start up. Current status is running
2023/01/19 00:02:30 2023-01-19 00:02:30. (24): Docker container is running. container_id = b'd6cc4e862af608c36df401d0a73b8317fe66ffa6187cd9f3c969da7f6a0c71e8', worker_id = worker_14
2023/01/19 00:02:31 2023-01-19 00:02:31. (25): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc9183852a0> for environment PEksABrvoTbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
2023/01/19 00:02:36 2023-01-19 00:02:36. (26): Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
2023/01/19 00:02:37 2023-01-19 00:02:37. (27): Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
2023/01/19 00:02:39 2023-01-19 00:02:39. (28): Waiting for docker to start up. Current status is running
2023/01/19 00:02:39 2023-01-19 00:02:39. (29): Docker container is running. container_id = b'e4adfa22bcfbda768bf7a5b32b2d9ed0da4351ea5cfc18f0695757d38f857ae1', worker_id = worker_16
2023/01/19 00:02:52 2023-01-19 00:02:52. (30): Completed job in 26.705727100372314 seconds with state DONE.
2023/01/19 00:02:52 Job state: DONE
--- PASS: TestJDBCIO_PostgresReadWrite (71.81s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 159.652s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.154s
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.44.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpegnfp1_i/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
org.apache.beam.sdk.extensions.python.PythonExternalTransformTest > pythonTransformWithDependencies FAILED
java.lang.RuntimeException at PythonExternalTransformTest.java:72
Caused by: java.util.concurrent.TimeoutException at PythonExternalTransformTest.java:72
15 tests completed, 1 failed
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 49m 10s
233 actionable tasks: 32 executed, 201 up-to-date
Publishing build scan...
https://gradle.com/s/eyfgmafhzaurg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3642
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3642/display/redirect?page=changes>
Changes:
[evanderwal] Add withDefaultHeaders to connection configuration for ElasticsearchIO
[evanderwal] Address PR comments, run spotless
[evanderwal] Fix copy/paste error in Javadoc, add example for usage of
[noreply] Add explicit error for PEP 585 type hints (#24986)
[noreply] Updated Python Container Dependencies (#25042)
[noreply] [ToB][Frontend] Display hints and solutions (#25020)
[noreply] upgrade clickhouse jdbc driver 0.3.2-patch10 (#24424)
[noreply] Added documentation for SingleStoreIO (#24377)
[noreply] Adding watermark support to DebeziumIO transform (#24757)
[John Casey] Moving to 2.46.0-SNAPSHOT on master branch.
[noreply] Fix error message (add proper spacing) (#25050)
------------------------------------------
[...truncated 1.17 MB...]
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'95fd3240594f988f6f6df7bb04c591e965bf1f368cb95a630fca7380842c0a06', worker_id = worker_75
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc741d4b90> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'd669f5c8f8212213e8a9b94ac113a93a1e2b8127f76598a8c85483c789e1c09b', worker_id = worker_76
INFO root:portable_runner.py:577 Completed job in 20.263445615768433 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '47947' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:47947
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:47947.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:47947.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:47947.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:12 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:47947.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:15 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:16 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:17 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:23 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:15:23 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f5b683f8a70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f5b683f8b00> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f5b683f9290> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fcc767c3c20> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fcc767c3d40> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fcc767c4290> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fcc767c4320> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fcc767c44d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fcc767c4560> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fcc767c4680> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fcc767c4710> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fcc767c47a0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fcc767c4830> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fcc767c4a70> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fcc767c4b90> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fcc767c49e0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fcc767c4b00> ====================
INFO root:portable_runner.py:577 starting control server on port 34759
INFO root:portable_runner.py:577 starting data server on port 43181
INFO root:portable_runner.py:577 starting state server on port 44751
INFO root:portable_runner.py:577 starting logging server on port 45183
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc746a31d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'f66633d6335d007acab7c7dad60670b826dd786be573e8a56d3b5192fe9cd402', worker_id = worker_77
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc7478c4d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'65d9ba9c80f1b38920e7656d3813117060bf2ac6629029ba22b60d3e853155a3', worker_id = worker_78
INFO root:portable_runner.py:577 Completed job in 22.923855781555176 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar'> '52639' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.46.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:52639
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:16:09 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:52639.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:16:19 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:16:19 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:16:21 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:16:27 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 6:16:31 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.46.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f5b683f8a70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f5b683f8b00> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f5b683f9290> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fcc767c3c20> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fcc767c3d40> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fcc767c4290> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fcc767c4320> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fcc767c44d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fcc767c4560> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fcc767c4680> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fcc767c4710> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fcc767c47a0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fcc767c4830> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fcc767c4a70> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fcc767c4b90> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fcc767c49e0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fcc767c4b00> ====================
INFO root:portable_runner.py:577 starting control server on port 46859
INFO root:portable_runner.py:577 starting data server on port 45955
INFO root:portable_runner.py:577 starting state server on port 43347
INFO root:portable_runner.py:577 starting logging server on port 43577
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc7460b2d0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'a1776f90c0bf6b00ebe6b06f839b25c7ba389bcf2752207f6b6b4bc57148d75b', worker_id = worker_79
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcc7472ba10> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.46.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.46.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.46.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'a101fb06610c7d7329acefb4ed86e1abfdf2b56d0b06f96bc2dd5207e7798d96', worker_id = worker_80
INFO root:portable_runner.py:577 Completed job in 26.19238042831421 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6792 deselected, 1 warning in 589.04s (0:09:49) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1209704
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1222236.
Stopping expansion service pid: 1222237.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 56m 9s
248 actionable tasks: 213 executed, 25 from cache, 10 up-to-date
Publishing build scan...
https://gradle.com/s/c33uvccfcwyem
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3641
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3641/display/redirect?page=changes>
Changes:
[noreply] enabling public construction of typed schematransforms (#25010)
------------------------------------------
[...truncated 1.16 MB...]
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'b3610d68321cd15ffc1609866461b1156cce22778f49bca70cd2204af16b0ed7', worker_id = worker_76
INFO root:portable_runner.py:577 Completed job in 14.10287356376648 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '43359' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:43359
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:32 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:34 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f233da7af80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f233da7b050> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f233da7b7a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fbb3338d170> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fbb3338d290> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fbb3338d7a0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fbb3338d830> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fbb3338d9e0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fbb3338da70> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fbb3338db90> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fbb3338dc20> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fbb3338dcb0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fbb3338dd40> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fbb3338df80> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fbb3338e0e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fbb3338def0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fbb3338e050> ====================
INFO root:portable_runner.py:577 starting control server on port 44607
INFO root:portable_runner.py:577 starting data server on port 45139
INFO root:portable_runner.py:577 starting state server on port 34625
INFO root:portable_runner.py:577 starting logging server on port 43211
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbb30735690> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'dd52b00e5f43c8a72a2728de70689a4e70371baace73bd6891e434d5af77a9ed', worker_id = worker_77
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbb3073dbd0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'1df9930fe2ef971ef6e6de642b9a623eb36b183b53ca1a108a519a2f0588ce5e', worker_id = worker_78
INFO root:portable_runner.py:577 Completed job in 13.495609045028687 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '50799' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:50799
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:55:58 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:56:00 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:56:00 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:56:00 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:56:02 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 18, 2023 11:56:04 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f233da7af80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f233da7b050> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f233da7b7a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fbb3338d170> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fbb3338d290> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fbb3338d7a0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fbb3338d830> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fbb3338d9e0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fbb3338da70> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fbb3338db90> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fbb3338dc20> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fbb3338dcb0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fbb3338dd40> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fbb3338df80> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fbb3338e0e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fbb3338def0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fbb3338e050> ====================
INFO root:portable_runner.py:577 starting control server on port 45943
INFO root:portable_runner.py:577 starting data server on port 41493
INFO root:portable_runner.py:577 starting state server on port 37693
INFO root:portable_runner.py:577 starting logging server on port 37199
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbb306a0990> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'3d75e1239680f014b81062751d9477cee96b20a9f4b5ab352936ef9037b09717', worker_id = worker_79
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbb3066f690> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'17c3b1b2da89bcd694786703b218199bf7f897601ba1ed677b63cc8ea1a4795c', worker_id = worker_80
INFO root:portable_runner.py:577 Completed job in 15.500777959823608 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6789 deselected, 1 warning in 312.46s (0:05:12) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3295463
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3300719.
Stopping expansion service pid: 3300720.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 45m 52s
248 actionable tasks: 166 executed, 70 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/qi7ayqxfcbm6i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3640
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3640/display/redirect?page=changes>
Changes:
[noreply] Bump json5 from 1.0.1 to 1.0.2 in
[relax] Properly synchronize pins
[relax] typo
------------------------------------------
[...truncated 519.14 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s2"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2023/01/18 05:22:36 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/debezium/debezium_test.go> as /tmp/worker-1-1674019356082518607
2023/01/18 05:22:38 Prepared job with id: go-testdebeziumio_basicread-970-708eae74-9597-4bef-b60e-dc95b25cbd3c and staging token: go-testdebeziumio_basicread-970-708eae74-9597-4bef-b60e-dc95b25cbd3c
2023/01/18 05:22:38 Staged binary artifact with token:
2023/01/18 05:22:38 Submitted job: go-testdebeziumio_basicread-970-708eae74-9597-4bef-b60e-dc95b25cbd3c
2023/01/18 05:22:38 2023-01-18 05:22:38. (1): Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
2023/01/18 05:22:38 Job state: STOPPED
2023/01/18 05:22:38 Job state: STARTING
2023/01/18 05:22:38 Job state: RUNNING
2023/01/18 05:22:38 2023-01-18 05:22:38. (2): ==================== <function annotate_downstream_side_inputs at 0x7f54a27c6170> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (3): ==================== <function fix_side_input_pcoll_coders at 0x7f54a27c6290> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (4): ==================== <function pack_combiners at 0x7f54a27c67a0> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (5): ==================== <function lift_combiners at 0x7f54a27c6830> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (6): ==================== <function expand_sdf at 0x7f54a27c69e0> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (7): ==================== <function expand_gbk at 0x7f54a27c6a70> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (8): ==================== <function sink_flattens at 0x7f54a27c6b90> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (9): ==================== <function greedily_fuse at 0x7f54a27c6c20> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (10): ==================== <function read_to_impulse at 0x7f54a27c6cb0> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (11): ==================== <function impulse_to_input at 0x7f54a27c6d40> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (12): ==================== <function sort_stages at 0x7f54a27c6f80> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (13): ==================== <function add_impulse_to_dangling_transforms at 0x7f54a27c70e0> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (14): ==================== <function setup_timer_mapping at 0x7f54a27c6ef0> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (15): ==================== <function populate_data_channel_coders at 0x7f54a27c7050> ====================
2023/01/18 05:22:38 2023-01-18 05:22:38. (16): starting control server on port 34071
2023/01/18 05:22:38 2023-01-18 05:22:38. (17): starting data server on port 35759
2023/01/18 05:22:39 2023-01-18 05:22:38. (18): starting state server on port 37727
2023/01/18 05:22:39 2023-01-18 05:22:38. (19): starting logging server on port 37741
2023/01/18 05:22:39 2023-01-18 05:22:38. (20): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f54a0eca3d0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2023/01/18 05:22:39 2023-01-18 05:22:38. (21): Attempting to pull image apache/beam_go_sdk:dev
2023/01/18 05:22:39 2023-01-18 05:22:39. (22): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2023/01/18 05:22:41 2023-01-18 05:22:41. (23): Waiting for docker to start up. Current status is running
2023/01/18 05:22:41 2023-01-18 05:22:41. (24): Docker container is running. container_id = b'e1adfc9be8ded12caa664369743644445030099e6ac2710b6a5965f3ef7a5eb1', worker_id = worker_2
2023/01/18 05:22:42 2023-01-18 05:22:42. (25): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f54a0ed20d0> for environment bRnrPFddlRbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
2023/01/18 05:22:42 2023-01-18 05:22:42. (26): Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
2023/01/18 05:22:43 2023-01-18 05:22:43. (27): Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
2023/01/18 05:22:44 2023-01-18 05:22:44. (28): Waiting for docker to start up. Current status is running
2023/01/18 05:22:44 2023-01-18 05:22:44. (29): Docker container is running. container_id = b'ba856859da5c224def667c9f60ffe82ad125d411a4867d92a53beafa535c7a76', worker_id = worker_3
2023/01/18 05:23:00 2023-01-18 05:23:00. (30): Completed job in 22.019567012786865 seconds with state DONE.
2023/01/18 05:23:00 Job state: DONE
--- PASS: TestDebeziumIO_BasicRead (34.23s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 37.272s
=== RUN TestJDBCIO_BasicReadWrite
2023/01/18 05:22:27 github.com/testcontainers/testcontainers-go - Connected to docker:
Server Version: 18.09.4
API Version: 1.39
Operating System: Ubuntu 20.04.3 LTS
Total Memory: 104630 MB
2023/01/18 05:22:31 Starting container id: 0d80d9d65d28 image: docker.io/testcontainers/ryuk:0.3.4
2023/01/18 05:22:31 Waiting for container id 0d80d9d65d28 image: docker.io/testcontainers/ryuk:0.3.4
2023/01/18 05:22:31 Container is ready id: 0d80d9d65d28 image: docker.io/testcontainers/ryuk:0.3.4
2023/01/18 05:22:32 Starting container id: ec32b65a62f2 image: postgres
2023/01/18 05:22:32 Waiting for container id ec32b65a62f2 image: postgres
2023/01/18 05:22:37 Container is ready id: ec32b65a62f2 image: postgres
--- FAIL: TestJDBCIO_BasicReadWrite (14.01s)
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_jdbc_write:v1 against localhost:43477 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LFhtIgycXA" is_bounded:BOUNDED windowing_strategy_id:"w0@LFhtIgycXA"}} windowing_strategies:{key:"w0@LFhtIgycXA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LFhtIgycXA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LFhtIgycXA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07role_id\x1a\x02\x10\x03\x12$abc5e222-ab8f-4f6f-800a-a58bb0f45675"}}} coders:{key:"c1@LFhtIgycXA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_jdbc_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$853bc92e-cc52-429e-bf30-f534bebcedce\x12`\x03\x01\x04\x05rolesV\n\x02\xf0\x03\x15org.postgresql.Driver*jdbc:postgresql://localhost:36403/postjdbc\x07newuser\x08password"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LFhtIgycXA"
expansion failed
caused by:
java.lang.IllegalArgumentException: Cannot find field maxConnections in schema Fields:
Field{name=driverClassName, description=, type=STRING NOT NULL, options={{}}}
Field{name=jdbcUrl, description=, type=STRING NOT NULL, options={{}}}
Field{name=username, description=, type=STRING NOT NULL, options={{}}}
Field{name=password, description=, type=STRING NOT NULL, options={{}}}
Field{name=connectionProperties, description=, type=STRING, options={{}}}
Field{name=connectionInitSqls, description=, type=ITERABLE, options={{}}}
Field{name=readQuery, description=, type=STRING, options={{}}}
Field{name=writeStatement, description=, type=STRING, options={{}}}
Field{name=fetchSize, description=, type=INT16, options={{}}}
Field{name=outputParallelization, description=, type=BOOLEAN, options={{}}}
Field{name=autosharding, description=, type=BOOLEAN, options={{}}}
Encoding positions:
{connectionProperties=4, autosharding=10, password=3, writeStatement=7, outputParallelization=9, fetchSize=8, driverClassName=0, jdbcUrl=1, connectionInitSqls=5, username=2, readQuery=6}
Options:{{}}UUID: 6511899e-b5a2-4d55-a77d-a5dbcb5b3290
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.schemas.Schema.indexOf(Schema.java:1365)
at org.apache.beam.sdk.values.Row.getInt32(Row.java:154)
at org.apache.beam.sdk.io.jdbc.JdbcSchemaIOProvider$JdbcSchemaIO.getDataSourceConfiguration(JdbcSchemaIOProvider.java:178)
at org.apache.beam.sdk.io.jdbc.JdbcSchemaIOProvider$JdbcSchemaIO$2.expand(JdbcSchemaIOProvider.java:144)
at org.apache.beam.sdk.io.jdbc.JdbcSchemaIOProvider$JdbcSchemaIO$2.expand(JdbcSchemaIOProvider.java:139)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
[recovered]
panic: tried cross-language for beam:transform:org.apache.beam:schemaio_jdbc_write:v1 against localhost:43477 and failed
expanding external transform
expanding transform with ExpansionRequest: components:{pcollections:{key:"n2" value:{unique_name:"n2" coder_id:"c0@LFhtIgycXA" is_bounded:BOUNDED windowing_strategy_id:"w0@LFhtIgycXA"}} windowing_strategies:{key:"w0@LFhtIgycXA" value:{window_fn:{urn:"beam:window_fn:global_windows:v1"} merge_status:NON_MERGING window_coder_id:"c1@LFhtIgycXA" trigger:{default:{}} accumulation_mode:DISCARDING output_time:END_OF_WINDOW closing_behavior:EMIT_IF_NONEMPTY on_time_behavior:FIRE_IF_NONEMPTY environment_id:"go"}} coders:{key:"c0@LFhtIgycXA" value:{spec:{urn:"beam:coder:row:v1" payload:"\n\r\n\x07role_id\x1a\x02\x10\x03\x12$abc5e222-ab8f-4f6f-800a-a58bb0f45675"}}} coders:{key:"c1@LFhtIgycXA" value:{spec:{urn:"beam:coder:global_window:v1"}}}} transform:{unique_name:"External" spec:{urn:"beam:transform:org.apache.beam:schemaio_jdbc_write:v1" payload:"\nX\n\x0e\n\x08location\x1a\x02\x10\x07\n\x0c\n\x06config\x1a\x02\x10\t\n\x12\n\ndataSchema\x1a\x04\x08\x01\x10\t\x12$853bc92e-cc52-429e-bf30-f534bebcedce\x12`\x03\x01\x04\x05rolesV\n\x02\xf0\x03\x15org.postgresql.Driver*jdbc:postgresql://localhost:36403/postjdbc\x07newuser\x08password"} inputs:{key:"i0" value:"n2"} environment_id:"go"} namespace:"LFhtIgycXA"
expansion failed
caused by:
java.lang.IllegalArgumentException: Cannot find field maxConnections in schema Fields:
Field{name=driverClassName, description=, type=STRING NOT NULL, options={{}}}
Field{name=jdbcUrl, description=, type=STRING NOT NULL, options={{}}}
Field{name=username, description=, type=STRING NOT NULL, options={{}}}
Field{name=password, description=, type=STRING NOT NULL, options={{}}}
Field{name=connectionProperties, description=, type=STRING, options={{}}}
Field{name=connectionInitSqls, description=, type=ITERABLE, options={{}}}
Field{name=readQuery, description=, type=STRING, options={{}}}
Field{name=writeStatement, description=, type=STRING, options={{}}}
Field{name=fetchSize, description=, type=INT16, options={{}}}
Field{name=outputParallelization, description=, type=BOOLEAN, options={{}}}
Field{name=autosharding, description=, type=BOOLEAN, options={{}}}
Encoding positions:
{connectionProperties=4, autosharding=10, password=3, writeStatement=7, outputParallelization=9, fetchSize=8, driverClassName=0, jdbcUrl=1, connectionInitSqls=5, username=2, readQuery=6}
Options:{{}}UUID: 6511899e-b5a2-4d55-a77d-a5dbcb5b3290
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
at org.apache.beam.sdk.schemas.Schema.indexOf(Schema.java:1365)
at org.apache.beam.sdk.values.Row.getInt32(Row.java:154)
at org.apache.beam.sdk.io.jdbc.JdbcSchemaIOProvider$JdbcSchemaIO.getDataSourceConfiguration(JdbcSchemaIOProvider.java:178)
at org.apache.beam.sdk.io.jdbc.JdbcSchemaIOProvider$JdbcSchemaIO$2.expand(JdbcSchemaIOProvider.java:144)
at org.apache.beam.sdk.io.jdbc.JdbcSchemaIOProvider$JdbcSchemaIO$2.expand(JdbcSchemaIOProvider.java:139)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
at org.apache.beam.sdk.expansion.service.ExpansionService$TransformProvider.apply(ExpansionService.java:400)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:526)
at org.apache.beam.sdk.expansion.service.ExpansionService.expand(ExpansionService.java:606)
at org.apache.beam.model.expansion.v1.ExpansionServiceGrpc$MethodHandlers.invoke(ExpansionServiceGrpc.java:305)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:354)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:866)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
goroutine 13 [running]:
testing.tRunner.func1.2({0xf46100, 0xc0005e0c40})
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1396 +0x24e
testing.tRunner.func1()
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1399 +0x39f
panic({0xf46100, 0xc0005e0c40})
/home/jenkins/sdk/go1.19.3/src/runtime/panic.go:884 +0x212
github.com/apache/beam/sdks/v2/go/pkg/beam.CrossLanguage({0xc000128c40?, 0xc0000ba370?}, {0x10b8987, 0x35}, {0xc0007100c0?, 0xc0004b7998?, 0xc00070c0b0?}, {0xc000122a90, 0xf}, 0xc0004b7b30, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/pkg/beam/xlang.go>:165 +0x136
github.com/apache/beam/sdks/v2/go/pkg/beam/io/xlang/jdbcio.Write({0xc000128c00?, 0xc0000ba370?}, {0x107f9f6, 0x5}, {0x1092292, 0x15}, {0xc000046d50, 0x2a}, {0x1082271, 0x7}, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/pkg/beam/io/xlang/jdbcio/jdbc.go>:173 +0x66b
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc.writeRows({0xc000128b60?, 0xc0000ba370?}, {0xc000122a90, 0xf}, {0x107f9f6, 0x5}, {0x1092292, 0x15}, {0xc000046d50, 0x2a}, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc.go>:38 +0x317
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc.WritePipeline({0xc000122a90, 0xf}, {0x107f9f6, 0x5}, {0x1092292, 0x15}, {0xc000046d50, 0x2a}, {0x1082271, 0x7}, ...)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc.go>:48 +0x293
github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc.TestJDBCIO_BasicReadWrite(0xc0005831e0)
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go>:112 +0x1f0
testing.tRunner(0xc0005831e0, 0x10ecad8)
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1446 +0x10b
created by testing.(*T).Run
/home/jenkins/sdk/go1.19.3/src/testing/testing.go:1493 +0x35f
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 17.058s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.040s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.sdk.extensions.python.PythonExternalTransformTest > pythonTransformWithDependencies FAILED
java.lang.RuntimeException at PythonExternalTransformTest.java:72
Caused by: java.util.concurrent.TimeoutException at PythonExternalTransformTest.java:72
15 tests completed, 1 failed
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 43m 56s
248 actionable tasks: 166 executed, 70 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ybohld3xeh35u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3639
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3639/display/redirect?page=changes>
Changes:
[noreply] Set allowDiskUse to true in MongoDB bucketAuto aggregation (#25013)
[Kiley Sok] Add kafka version to pom
[relax] add public qualifier
[Kenneth Knowles] Website updates for Beam 2.44.0 release
------------------------------------------
[...truncated 1.16 MB...]
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fa33db08ef0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fa33db09050> ====================
INFO root:portable_runner.py:577 starting control server on port 33081
INFO root:portable_runner.py:577 starting data server on port 39039
INFO root:portable_runner.py:577 starting state server on port 42413
INFO root:portable_runner.py:577 starting logging server on port 42063
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa33c1e6650> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'ce68a03d7869a8c4837c5020604857b755763ccbffd5194599150affee26a6f1', worker_id = worker_75
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa33c017110> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'477f1499105ddb5c1763dff39c360a42d2254dea2a6dcc70285e7a247850fc5e', worker_id = worker_76
INFO root:portable_runner.py:577 Completed job in 17.887394666671753 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '55587' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:55587
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:45 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:55587.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:48 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:48 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:48 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:50 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:50 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:46:50 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f9a39ef7f80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f9a39ef8050> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f9a39ef87a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fa33db08170> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fa33db08290> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fa33db087a0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fa33db08830> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fa33db089e0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fa33db08a70> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fa33db08b90> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fa33db08c20> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fa33db08cb0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fa33db08d40> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fa33db08f80> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fa33db090e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fa33db08ef0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fa33db09050> ====================
INFO root:portable_runner.py:577 starting control server on port 33347
INFO root:portable_runner.py:577 starting data server on port 36171
INFO root:portable_runner.py:577 starting state server on port 43689
INFO root:portable_runner.py:577 starting logging server on port 38167
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa33c1a76d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'f2e129a54a1f9b1cd7fabce97f28e7cab87a5dcc50351c7f1fc2e07f837abe92', worker_id = worker_77
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa33c18cd10> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'7ae0256db2230b3aa98d8ecf2ee01619601e9c405b1cb921e94b4d50a3dcbcd8', worker_id = worker_78
INFO root:portable_runner.py:577 Completed job in 15.959704160690308 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '46805' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:46805
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:47:17 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:46805.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:47:20 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:47:20 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:47:20 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:47:22 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 17, 2023 11:47:24 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f9a39ef7f80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f9a39ef8050> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f9a39ef87a0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7fa33db08170> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7fa33db08290> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7fa33db087a0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7fa33db08830> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7fa33db089e0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7fa33db08a70> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7fa33db08b90> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7fa33db08c20> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7fa33db08cb0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7fa33db08d40> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7fa33db08f80> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7fa33db090e0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7fa33db08ef0> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7fa33db09050> ====================
INFO root:portable_runner.py:577 starting control server on port 35253
INFO root:portable_runner.py:577 starting data server on port 42877
INFO root:portable_runner.py:577 starting state server on port 44977
INFO root:portable_runner.py:577 starting logging server on port 39383
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa3187d2310> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'f68b2b13c484117f439b7782c528d3f7e3b50e76f2c8c50568066be6edf10624', worker_id = worker_79
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fa318797850> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'6c24bce7259a4fd47ed10dc9682091c36874b9229f80b458a4d7cf6d89e95c5d', worker_id = worker_80
INFO root:portable_runner.py:577 Completed job in 15.977624654769897 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6789 deselected, 1 warning in 266.55s (0:04:26) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 58771
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 61702.
Stopping expansion service pid: 61703.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 193
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 37m 19s
248 actionable tasks: 167 executed, 69 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/wjap4766yjdju
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org