You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/01/15 11:55:06 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3629
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3629/display/redirect>
Changes:
------------------------------------------
[...truncated 1.46 MB...]
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f77b5550950> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f77b55509e0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f77b5550a70> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f77b5550cb0> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f77b5550dd0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f77b5550c20> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f77b5550d40> ====================
INFO root:portable_runner.py:577 starting control server on port 40379
INFO root:portable_runner.py:577 starting data server on port 36425
INFO root:portable_runner.py:577 starting state server on port 43053
INFO root:portable_runner.py:577 starting logging server on port 44841
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77b41b1c10> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'310172a5e29c7c36ffa913e058582debb5c3b747f4b1f46c6fb956f65535a44a', worker_id = worker_83
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77b41e31d0> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'6918dca60b65d34576c84033f87bc3c203d25defe428d1d946a5d12b21dded3f', worker_id = worker_84
INFO root:portable_runner.py:577 Completed job in 12.237570524215698 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '60065' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:60065
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:08 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:10 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:10 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:10 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:12 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:12 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:12 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f44689c4cb0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f44689c4d40> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f44689c64d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f77b554de60> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f77b554df80> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f77b55504d0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f77b5550560> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f77b5550710> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f77b55507a0> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f77b55508c0> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f77b5550950> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f77b55509e0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f77b5550a70> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f77b5550cb0> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f77b5550dd0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f77b5550c20> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f77b5550d40> ====================
INFO root:portable_runner.py:577 starting control server on port 33819
INFO root:portable_runner.py:577 starting data server on port 38321
INFO root:portable_runner.py:577 starting state server on port 34391
INFO root:portable_runner.py:577 starting logging server on port 35353
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77b4387510> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'ce683ff122fc46681f168f138b41d0f53b7bd85f811f2628a4c94b0748384fad', worker_id = worker_85
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77b41d4650> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'c863e3a7f6c597445e6a37cfcffc7b86bd0afb19b6da3e59e2e428b11a46e3de', worker_id = worker_86
INFO root:portable_runner.py:577 Completed job in 12.330138444900513 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'> '32969' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:32969
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:33 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:34 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:35 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:37 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 15, 2023 11:54:38 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7f44689c4cb0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7f44689c4d40> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7f44689c64d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function annotate_downstream_side_inputs at 0x7f77b554de60> ====================
INFO root:portable_runner.py:577 ==================== <function fix_side_input_pcoll_coders at 0x7f77b554df80> ====================
INFO root:portable_runner.py:577 ==================== <function pack_combiners at 0x7f77b55504d0> ====================
INFO root:portable_runner.py:577 ==================== <function lift_combiners at 0x7f77b5550560> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf at 0x7f77b5550710> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk at 0x7f77b55507a0> ====================
INFO root:portable_runner.py:577 ==================== <function sink_flattens at 0x7f77b55508c0> ====================
INFO root:portable_runner.py:577 ==================== <function greedily_fuse at 0x7f77b5550950> ====================
INFO root:portable_runner.py:577 ==================== <function read_to_impulse at 0x7f77b55509e0> ====================
INFO root:portable_runner.py:577 ==================== <function impulse_to_input at 0x7f77b5550a70> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages at 0x7f77b5550cb0> ====================
INFO root:portable_runner.py:577 ==================== <function add_impulse_to_dangling_transforms at 0x7f77b5550dd0> ====================
INFO root:portable_runner.py:577 ==================== <function setup_timer_mapping at 0x7f77b5550c20> ====================
INFO root:portable_runner.py:577 ==================== <function populate_data_channel_coders at 0x7f77b5550d40> ====================
INFO root:portable_runner.py:577 starting control server on port 38421
INFO root:portable_runner.py:577 starting data server on port 38857
INFO root:portable_runner.py:577 starting state server on port 36607
INFO root:portable_runner.py:577 starting logging server on port 37953
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77b426c0d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'3c02d46fc7299dc8d834e7bee11c4dd9178cf6709d352cf660a7df830b04cf57', worker_id = worker_87
INFO root:portable_runner.py:577 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f77b4276a50> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:577 Docker container is running. container_id = b'8f017f1af7f4d042eb6c6ad8e398389688213a03309c633e4d6f246eaef7975a', worker_id = worker_88
INFO root:portable_runner.py:577 Completed job in 14.357112646102905 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
===== 9 passed, 6 skipped, 6788 deselected, 1 warning in 238.66s (0:03:58) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3464006
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3468236.
Stopping expansion service pid: 3468237.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 44m 34s
248 actionable tasks: 163 executed, 73 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/xmivic37nuwq2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #3632
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3632/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3631
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3631/display/redirect>
Changes:
------------------------------------------
[...truncated 583.66 KB...]
[0m[91m adding 'apache_beam/typehints/testing/strategies.py'
[0m[91m adding 'apache_beam/utils/__init__.py'
[0m[91m adding 'apache_beam/utils/annotations.py'
[0m[91m adding 'apache_beam/utils/annotations_test.py'
[0m[91m adding 'apache_beam/utils/counters.cpython-37m-x86_64-linux-gnu.so'
[0m[91m adding 'apache_beam/utils/counters.pxd'
[0m[91m adding 'apache_beam/utils/counters.py'
[0m[91m adding 'apache_beam/utils/counters_test.py'
[0m[91m adding 'apache_beam/utils/histogram.py'
[0m[91m adding 'apache_beam/utils/histogram_test.py'
[0m[91m adding 'apache_beam/utils/interactive_utils.py'
[0m[91m adding 'apache_beam/utils/interactive_utils_test.py'
[0m[91m adding 'apache_beam/utils/multi_process_shared.py'
[0m[91m adding 'apache_beam/utils/multi_process_shared_test.py'
[0m[91m adding 'apache_beam/utils/plugin.py'
[0m[91m adding 'apache_beam/utils/processes.py'
[0m[91m adding 'apache_beam/utils/processes_test.py'
[0m[91m adding 'apache_beam/utils/profiler.py'
[0m[91m adding 'apache_beam/utils/profiler_test.py'
[0m[91m adding 'apache_beam/utils/proto_utils.py'
[0m[91m adding 'apache_beam/utils/python_callable.py'
[0m[91m adding 'apache_beam/utils/python_callable_test.py'
[0m[91m adding 'apache_beam/utils/retry.py'
[0m[91m adding 'apache_beam/utils/retry_test.py'
[0m[91m adding 'apache_beam/utils/sentinel.py'
[0m[91m adding 'apache_beam/utils/sharded_key.py'
[0m[91m adding 'apache_beam/utils/shared.py'
[0m[91m adding 'apache_beam/utils/shared_test.py'
[0m[91m adding 'apache_beam/utils/subprocess_server.py'
[0m[91m adding 'apache_beam/utils/subprocess_server_test.py'
[0m[91m adding 'apache_beam/utils/thread_pool_executor.py'
[0m[91m adding 'apache_beam/utils/thread_pool_executor_test.py'
[0m[91m adding 'apache_beam/utils/timestamp.py'
[0m[91m adding 'apache_beam/utils/timestamp_test.py'
[0m[91m adding 'apache_beam/utils/urns.py'
[0m[91m adding 'apache_beam/utils/windowed_value.cpython-37m-x86_64-linux-gnu.so'
[0m[91m adding 'apache_beam/utils/windowed_value.pxd'
[0m[91m adding 'apache_beam/utils/windowed_value.py'
[0m[91m adding 'apache_beam/utils/windowed_value_test.py'
[0m[91m adding 'apache_beam-2.45.0.dev0.dist-info/METADATA'
[0m[91m adding 'apache_beam-2.45.0.dev0.dist-info/WHEEL'
[0m[91m adding 'apache_beam-2.45.0.dev0.dist-info/top_level.txt'
[0m[91m adding 'apache_beam-2.45.0.dev0.dist-info/RECORD'
[0m[91m removing build/bdist.linux-x86_64/wheel
[0m Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.45.0.dev0-cp37-cp37m-linux_x86_64.whl size=13261080 sha256=b7421611625789c9047cd8fe616268d7b871c40aed5d8ba5d2b0db7704a0c6ad
Stored in directory: /root/.cache/pip/wheels/28/ff/f0/ff79ce04b6816e49da2c05be79af2a4b8c12f71315cd66f4a0
Successfully built apache-beam
Installing collected packages: apache-beam
Successfully installed apache-beam-2.45.0.dev0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container 4979e2022c08
---> 3ed531b6372e
Step 15/32 : RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1)
---> Running in d6873a98d9ec
No broken requirements found.
Removing intermediate container d6873a98d9ec
---> d43f95b541b0
Step 16/32 : RUN pip freeze --all
---> Running in adc1fe04dae6
absl-py==1.3.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
attrs==22.1.0
beautifulsoup4==4.11.1
bs4==0.0.1
CacheControl==0.12.11
cachetools==4.2.4
certifi==2022.12.7
cffi==1.15.1
charset-normalizer==2.1.1
click==8.1.3
cloudpickle==2.2.0
crcmod==1.7
cryptography==38.0.4
Cython==0.29.32
deprecation==2.1.0
dill==0.3.1.1
docker==6.0.1
docopt==0.6.2
exceptiongroup==1.0.4
execnet==1.9.0
fastavro==1.7.0
fasteners==0.18
firebase-admin==5.2.0
flatbuffers==22.12.6
freezegun==1.2.2
future==0.18.2
gast==0.4.0
google-api-core==2.11.0
google-api-python-client==2.68.0
google-apitools==0.5.31
google-auth==2.15.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==3.4.0
google-cloud-bigquery-storage==2.16.2
google-cloud-bigtable==1.7.3
google-cloud-core==2.3.2
google-cloud-datastore==1.15.5
google-cloud-dlp==3.9.2
google-cloud-firestore==2.7.2
google-cloud-language==1.3.2
google-cloud-profiler==3.1.0
google-cloud-pubsub==2.13.11
google-cloud-pubsublite==1.6.0
google-cloud-recommendations-ai==0.7.1
google-cloud-spanner==3.24.0
google-cloud-storage==2.7.0
google-cloud-videointelligence==1.16.3
google-cloud-vision==3.1.4
google-crc32c==1.5.0
google-pasta==0.2.0
google-python-cloud-debugger==3.1
google-resumable-media==2.4.0
googleapis-common-protos==1.57.0
greenlet==2.0.1
grpc-google-iam-v1==0.12.4
grpcio==1.51.1
grpcio-status==1.48.2
guppy3==3.1.2
h5py==3.7.0
hdfs==2.7.0
httplib2==0.20.4
hypothesis==6.60.0
idna==3.4
importlib-metadata==5.1.0
iniconfig==1.1.1
joblib==1.2.0
keras==2.11.0
libclang==14.0.6
Markdown==3.4.1
MarkupSafe==2.1.1
mmh3==3.0.0
mock==2.0.0
msgpack==1.0.4
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.2
objsize==0.6.1
opt-einsum==3.3.0
orjson==3.8.3
overrides==6.5.0
packaging==21.3
pandas==1.3.5
parameterized==0.8.1
pbr==5.11.0
pip==22.3.1
pluggy==1.0.0
proto-plus==1.22.1
protobuf==3.19.6
psycopg2-binary==2.9.5
py==1.11.0
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.13.0
PyMySQL==1.0.2
pyparsing==3.0.9
pytest==7.2.0
pytest-forked==1.4.0
pytest-timeout==2.1.0
pytest-xdist==2.5.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.6
PyYAML==6.0
regex==2022.10.31
requests==2.28.1
requests-mock==1.10.0
requests-oauthlib==1.3.1
rsa==4.9
scikit-learn==1.0.2
scipy==1.7.3
setuptools==65.7.0
six==1.16.0
sortedcontainers==2.4.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.44
sqlparse==0.4.3
tenacity==5.1.5
tensorboard==2.11.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.11.0
tensorflow-estimator==2.11.0
tensorflow-io-gcs-filesystem==0.28.0
termcolor==2.1.1
testcontainers==3.7.1
threadpoolctl==3.1.0
tomli==2.0.1
tqdm==4.64.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.13
websocket-client==1.4.2
Werkzeug==2.2.2
wheel==0.38.4
wrapt==1.14.1
zipp==3.11.0
zstandard==0.19.0
Removing intermediate container adc1fe04dae6
---> 24f7e967287f
Step 17/32 : COPY target/LICENSE /opt/apache/beam/
---> 7290a5491c26
Step 18/32 : COPY target/LICENSE.python /opt/apache/beam/
---> 27303df49247
Step 19/32 : COPY target/NOTICE /opt/apache/beam/
---> 6420bacec710
Step 20/32 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
COPY failed: stat /var/lib/docker/tmp/docker-builder703807401/target/launcher/linux_amd64/boot: no such file or directory
> Task :sdks:python:container:py37:docker FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py37:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 9m 34s
241 actionable tasks: 156 executed, 73 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/ygz5vhqqga5cy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3630
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3630/display/redirect>
Changes:
------------------------------------------
[...truncated 2.56 MB...]
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'b14cee84910da9f0ff43b5ec508bf4840104b8056eb7b9622b509ff7a0bacd06', worker_id = worker_55
INFO root:portable_runner.py:574 Completed job in 21.57637357711792 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 20%]
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform
-------------------------------- live log call ---------------------------------
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.45.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.10_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe35770f9a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe35770fa30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe3577741f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.45.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f6170cdb250> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f6170cdb370> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f6170cdb880> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f6170cdb910> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f6170cdbac0> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f6170cdbb50> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f6170cdbc70> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f6170cdbd00> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f6170cdbd90> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f6170cdbe20> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f6170cdc0d0> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f6170cdc1f0> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f6170cdc040> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f6170cdc160> ====================
INFO root:portable_runner.py:574 starting control server on port 39705
INFO root:portable_runner.py:574 starting data server on port 34053
INFO root:portable_runner.py:574 starting state server on port 36069
INFO root:portable_runner.py:574 starting logging server on port 34955
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6170b87fd0> for environment external_3beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'9d2f6bc07b114db8d53c64e7b64d9f2a9344f1d2df7215d5700e7186b5694420', worker_id = worker_56
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6170209990> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.10_sdk:2.45.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.10_sdk:2.45.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'5bd54dae2e1008782a43c0678a14e27348538e7f174517a978c6cb4a19f76837', worker_id = worker_57
INFO root:portable_runner.py:574 Completed job in 23.6601824760437 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key
-------------------------------- live log call ---------------------------------
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.45.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.10_sdk:2.45.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7fe35770f9a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7fe35770fa30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7fe3577741f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.45.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f6170cdb250> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f6170cdb370> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f6170cdb880> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f6170cdb910> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f6170cdbac0> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f6170cdbb50> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f6170cdbc70> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f6170cdbd00> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f6170cdbd90> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f6170cdbe20> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f6170cdc0d0> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f6170cdc1f0> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f6170cdc040> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f6170cdc160> ====================
INFO root:portable_runner.py:574 starting control server on port 34979
INFO root:portable_runner.py:574 starting data server on port 42249
INFO root:portable_runner.py:574 starting state server on port 38137
INFO root:portable_runner.py:574 starting logging server on port 38665
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f61701382b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n%apache/beam_python3.10_sdk:2.45.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.10_sdk:2.45.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.10_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'e623f76783aaa18817aa9d9f79f0479081ca65db8329dc33146cf8e08ccaa29a', worker_id = worker_58
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6170117250> for environment external_4beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'd803ad6a5d98b26dad6ae7bb20a04fcac826efa7d9b9127e1c964cfdcc3fc1b7', worker_id = worker_59
INFO root:portable_runner.py:574 Completed job in 25.05017638206482 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [ 40%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally FAILED [ 50%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key FAILED [ 60%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key FAILED [ 70%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput FAILED [ 80%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition FAILED [ 90%]
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix FAILED [100%]Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/bin/pytest",> line 8, in <module>
sys.exit(console_main())
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 190, in console_main
code = main()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 167, in main
ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_hooks.py",> line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_manager.py",> line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 60, in _multicall
return outcome.get_result()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_result.py",> line 60, in get_result
raise ex[1].with_traceback(ex[2])
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 39, in _multicall
res = hook_impl.function(*args)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/main.py",> line 317, in pytest_cmdline_main
return wrap_session(config, _main)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/main.py",> line 305, in wrap_session
config.hook.pytest_sessionfinish(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_hooks.py",> line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_manager.py",> line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 55, in _multicall
gen.send(outcome)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/terminal.py",> line 808, in pytest_sessionfinish
outcome.get_result()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_result.py",> line 60, in get_result
raise ex[1].with_traceback(ex[2])
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 39, in _multicall
res = hook_impl.function(*args)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/junitxml.py",> line 682, in pytest_sessionfinish
logfile.write(ET.tostring(testsuites, encoding="unicode"))
OSError: [Errno 28] No space left on device
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:36979 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/bin/pytest",> line 8, in <module>
sys.exit(console_main())
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 190, in console_main
code = main()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 148, in main
config = _prepareconfig(args, plugins)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 329, in _prepareconfig
config = pluginmanager.hook.pytest_cmdline_parse(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_hooks.py",> line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_manager.py",> line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 55, in _multicall
gen.send(outcome)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/helpconfig.py",> line 103, in pytest_cmdline_parse
config: Config = outcome.get_result()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_result.py",> line 60, in get_result
raise ex[1].with_traceback(ex[2])
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 39, in _multicall
res = hook_impl.function(*args)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 1058, in pytest_cmdline_parse
self.parse(args)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 1346, in parse
self._preparse(args, addopts=addopts)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/config/__init__.py",> line 1248, in _preparse
self.hook.pytest_load_initial_conftests(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_hooks.py",> line 265, in __call__
return self._hookexec(self.name, self.get_hookimpls(), kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_manager.py",> line 80, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 60, in _multicall
return outcome.get_result()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_result.py",> line 60, in get_result
raise ex[1].with_traceback(ex[2])
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/pluggy/_callers.py",> line 34, in _multicall
next(gen) # first yield
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/capture.py",> line 141, in pytest_load_initial_conftests
capman.start_global_capturing()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/capture.py",> line 688, in start_global_capturing
self._global_capturing = _get_multicapture(self._method)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/capture.py",> line 630, in _get_multicapture
return MultiCapture(in_=FDCapture(0), out=FDCapture(1), err=FDCapture(2))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/capture.py",> line 388, in __init__
TemporaryFile(buffering=0),
File "/usr/lib/python3.10/tempfile.py", line 735, in TemporaryFile
prefix, suffix, dir, output_type = _sanitize_params(prefix, suffix, dir)
File "/usr/lib/python3.10/tempfile.py", line 265, in _sanitize_params
dir = gettempdir()
File "/usr/lib/python3.10/tempfile.py", line 438, in gettempdir
return _os.fsdecode(_gettempdir())
File "/usr/lib/python3.10/tempfile.py", line 431, in _gettempdir
tempdir = _get_default_tempdir()
File "/usr/lib/python3.10/tempfile.py", line 363, in _get_default_tempdir
raise FileNotFoundError(_errno.ENOENT,
FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python']>
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4015051
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4017951.
Stopping expansion service pid: 4017952.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 37m 6s
233 actionable tasks: 32 executed, 201 up-to-date
Publishing build scan...
https://gradle.com/s/iugazg2h4fmwq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org