You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/09 21:18:14 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #3683
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3683/display/redirect>
Changes:
------------------------------------------
[...truncated 889.32 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:16:33 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT `simple`.`id` AS `id`, `enrich`.`metadata` AS `metadata`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`simple` AS `simple`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INNER JOIN `beam`.`enrich` AS `enrich` ON `simple`.`id` = `enrich`.`id`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:16:34 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalProject(id=[$0], metadata=[$4])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalJoin(condition=[=($0, $3)], joinType=[inner])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, simple]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, enrich]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:16:34 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamCalcRel(expr#0..4=[{inputs}], id=[$t0], metadata=[$t4])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamCoGBKJoinRel(condition=[=($0, $3)], joinType=[inner])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, simple]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, enrich]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f991ead7ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f991ead7f70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f991ead6700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '59615' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:59615
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:06 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:59615.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:10 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:12 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:12 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:12 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f991ead7ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f991ead7f70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f991ead6700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '57507' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:57507
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:40 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:41 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:43 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 9:17:45 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f991ead7ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f991ead7f70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f991ead6700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 360.27s (0:06:00) =====
> Task :runners:spark:3:job-server:sparkJobServerCleanup
Stopping job server pid: 2888679.
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2900427.
Stopping expansion service pid: 2900428.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 52m 45s
275 actionable tasks: 186 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/wzk7tcg5kr4xg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark3 #3687
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3687/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #3686
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3686/display/redirect>
Changes:
------------------------------------------
[...truncated 689.93 KB...]
#9 350.1 nltk==3.8.1
#9 350.1 nose==1.3.7
#9 350.1 numpy==1.24.4
#9 350.1 oauth2client==4.1.3
#9 350.1 objsize==0.6.1
#9 350.1 orjson==3.9.7
#9 350.1 overrides==6.5.0
#9 350.1 packaging==23.1
#9 350.1 pandas==1.5.3
#9 350.1 parameterized==0.9.0
#9 350.1 pip==23.0.1
#9 350.1 pluggy==1.3.0
#9 350.1 proto-plus==1.22.3
#9 350.1 protobuf==4.24.3
#9 350.1 psycopg2-binary==2.9.7
#9 350.1 pyarrow==11.0.0
#9 350.1 pyasn1==0.5.0
#9 350.1 pyasn1-modules==0.3.0
#9 350.1 pycparser==2.21
#9 350.1 pydot==1.4.2
#9 350.1 PyHamcrest==2.0.4
#9 350.1 pyjsparser==2.7.1
#9 350.1 pymongo==4.5.0
#9 350.1 PyMySQL==1.1.0
#9 350.1 pyparsing==3.1.1
#9 350.1 pytest==7.4.2
#9 350.1 pytest-timeout==2.1.0
#9 350.1 pytest-xdist==3.3.1
#9 350.1 python-dateutil==2.8.2
#9 350.1 python-snappy==0.6.1
#9 350.1 pytz==2023.3.post1
#9 350.1 PyYAML==6.0.1
#9 350.1 regex==2023.8.8
#9 350.1 requests==2.31.0
#9 350.1 requests-mock==1.11.0
#9 350.1 rsa==4.9
#9 350.1 scikit-learn==1.3.1
#9 350.1 scipy==1.10.1
#9 350.1 setuptools==68.2.2
#9 350.1 Shapely==1.8.5.post1
#9 350.1 six==1.16.0
#9 350.1 sortedcontainers==2.4.0
#9 350.1 soupsieve==2.5
#9 350.1 SQLAlchemy==1.4.49
#9 350.1 sqlparse==0.4.4
#9 350.1 tenacity==8.2.3
#9 350.1 testcontainers==3.7.1
#9 350.1 threadpoolctl==3.2.0
#9 350.1 tomli==2.0.1
#9 350.1 tqdm==4.66.1
#9 350.1 typing_extensions==4.8.0
#9 350.1 tzlocal==5.0.1
#9 350.1 uritemplate==4.1.1
#9 350.1 urllib3==1.26.17
#9 350.1 websocket-client==1.6.3
#9 350.1 wheel==0.41.2
#9 350.1 wrapt==1.15.0
#9 350.1 zstandard==0.21.0
#9 DONE 351.0s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.012 Collecting pip-licenses<5
#13 1.076 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB)
#13 1.085 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.086 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.3)
#13 1.148 Collecting prettytable>=2.3.0
#13 1.164 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
#13 1.219 Collecting wcwidth
#13 1.234 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
#13 2.529 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.686 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8
#13 2.686 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.842
#13 2.842 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.842 [notice] To update, run: pip install --upgrade pip
#13 17.84 Skip pulling license for bs4
#13 17.84 INFO:root:Successfully pulled licenses for 118 dependencies
#13 DONE 17.9s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 13.4s done
#16 writing image sha256:b775b14fbf39713a6cf2ba3a2b2d3fc1c27be876f0628960a343ba73ea61d894 done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.52.0.dev done
#16 DONE 13.4s
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2
#1 [internal] load build definition from Dockerfile
#1 DONE 0.0s
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.3s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.38MB 0.2s done
#5 DONE 0.2s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.374 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.451 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.481 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 0.583 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 0.773 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB]
#6 0.816 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.046 Fetched 8542 kB in 2s (4944 kB/s)
#6 2.046 Reading package lists...
#6 2.667 Reading package lists...
#6 3.262 Building dependency tree...
#6 3.410 Reading state information...
#6 3.554 The following additional packages will be installed:
#6 3.554 openssl
#6 3.594 The following NEW packages will be installed:
#6 3.595 ca-certificates openssl
#6 3.663 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded.
#6 3.663 Need to get 1017 kB of archives.
#6 3.663 After this operation, 1897 kB of additional disk space will be used.
#6 3.663 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 3.802 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 3.942 debconf: delaying package configuration, since apt-utils is not installed
#6 3.970 Fetched 1017 kB in 0s (5003 kB/s)
#6 3.991 Selecting previously unselected package openssl.
#6 3.991 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 3.998 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 4.001 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 4.111 Selecting previously unselected package ca-certificates.
#6 4.112 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 4.115 Unpacking ca-certificates (20210119) ...
#6 4.171 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 4.185 Setting up ca-certificates (20210119) ...
#6 4.725 Updating certificates in /etc/ssl/certs...
#6 5.377 129 added, 0 removed; done.
#6 5.420 Processing triggers for ca-certificates (20210119) ...
#6 5.428 Updating certificates in /etc/ssl/certs...
#6 5.957 0 added, 0 removed; done.
#6 5.957 Running hooks in /etc/ca-certificates/update.d...
#6 5.958 done.
#6 DONE 6.1s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.3s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "false" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.3s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:9bdc5cfb20b3d000e7e895380342706e6bd5dc899e768b505992f92c8fc820c6 done
#12 naming to docker.io/apache/beam_go_sdk:dev done
#12 DONE 0.2s
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0
go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0
/home/jenkins/go/bin/go1.21.0 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 1 -v -timeout 3h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test22231 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test22231 --endpoint=localhost:45709 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.52.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.52.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --bt_instance=projects/apache-beam-testing/instances/beam-test --expansion_addr=test:localhost:46057
# github.com/apache/beam/sdks/v2/go/test/integration
test/integration/integration.go:41:2: "os" imported and not used
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed]
FAIL
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 40243
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpc97wdzl1/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 34857
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:sparkJobServerCleanup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 41m 29s
275 actionable tasks: 186 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cbm7ex6f7rnf4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #3685
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3685/display/redirect>
Changes:
------------------------------------------
[...truncated 734.87 KB...]
#9 336.4 nltk==3.8.1
#9 336.4 nose==1.3.7
#9 336.4 numpy==1.24.4
#9 336.4 oauth2client==4.1.3
#9 336.4 objsize==0.6.1
#9 336.4 orjson==3.9.7
#9 336.4 overrides==6.5.0
#9 336.4 packaging==23.1
#9 336.4 pandas==1.5.3
#9 336.4 parameterized==0.9.0
#9 336.4 pip==23.0.1
#9 336.4 pluggy==1.3.0
#9 336.4 proto-plus==1.22.3
#9 336.4 protobuf==4.24.3
#9 336.4 psycopg2-binary==2.9.7
#9 336.4 pyarrow==11.0.0
#9 336.4 pyasn1==0.5.0
#9 336.4 pyasn1-modules==0.3.0
#9 336.4 pycparser==2.21
#9 336.4 pydot==1.4.2
#9 336.4 PyHamcrest==2.0.4
#9 336.4 pyjsparser==2.7.1
#9 336.4 pymongo==4.5.0
#9 336.4 PyMySQL==1.1.0
#9 336.4 pyparsing==3.1.1
#9 336.4 pytest==7.4.2
#9 336.4 pytest-timeout==2.1.0
#9 336.4 pytest-xdist==3.3.1
#9 336.4 python-dateutil==2.8.2
#9 336.4 python-snappy==0.6.1
#9 336.4 pytz==2023.3.post1
#9 336.4 PyYAML==6.0.1
#9 336.4 regex==2023.8.8
#9 336.4 requests==2.31.0
#9 336.4 requests-mock==1.11.0
#9 336.4 rsa==4.9
#9 336.4 scikit-learn==1.3.1
#9 336.4 scipy==1.10.1
#9 336.4 setuptools==68.2.2
#9 336.4 Shapely==1.8.5.post1
#9 336.4 six==1.16.0
#9 336.4 sortedcontainers==2.4.0
#9 336.4 soupsieve==2.5
#9 336.4 SQLAlchemy==1.4.49
#9 336.4 sqlparse==0.4.4
#9 336.4 tenacity==8.2.3
#9 336.4 testcontainers==3.7.1
#9 336.4 threadpoolctl==3.2.0
#9 336.4 tomli==2.0.1
#9 336.4 tqdm==4.66.1
#9 336.4 typing_extensions==4.8.0
#9 336.4 tzlocal==5.0.1
#9 336.4 uritemplate==4.1.1
#9 336.4 urllib3==1.26.17
#9 336.4 websocket-client==1.6.3
#9 336.4 wheel==0.41.2
#9 336.4 wrapt==1.15.0
#9 336.4 zstandard==0.21.0
#9 DONE 337.4s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 0.992 Collecting pip-licenses<5
#13 1.053 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB)
#13 1.062 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.063 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.3)
#13 1.121 Collecting prettytable>=2.3.0
#13 1.138 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
#13 1.197 Collecting wcwidth
#13 1.212 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
#13 2.473 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.633 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8
#13 2.633 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.784
#13 2.784 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.784 [notice] To update, run: pip install --upgrade pip
#13 9.939 INFO:root:Successfully pulled licenses for 118 dependencies
#13 9.939 Skip pulling license for bs4
#13 DONE 10.0s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.3s
#16 exporting to image
#16 exporting layers
#16 exporting layers 13.4s done
#16 writing image sha256:93132e89fc967263442843ac44fed80b3e6382caa7a8cb0b29418f7d5effe1c8 done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.52.0.dev done
#16 DONE 13.4s
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2
#1 [internal] load build definition from Dockerfile
#1 DONE 0.0s
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.3s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.34MB 0.2s done
#5 DONE 0.2s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.393 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.493 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.532 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 0.623 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 0.870 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB]
#6 0.872 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.139 Fetched 8542 kB in 2s (4702 kB/s)
#6 2.139 Reading package lists...
#6 2.753 Reading package lists...
#6 3.361 Building dependency tree...
#6 3.501 Reading state information...
#6 3.639 The following additional packages will be installed:
#6 3.639 openssl
#6 3.677 The following NEW packages will be installed:
#6 3.678 ca-certificates openssl
#6 3.731 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded.
#6 3.731 Need to get 1017 kB of archives.
#6 3.731 After this operation, 1897 kB of additional disk space will be used.
#6 3.731 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 3.790 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 3.932 debconf: delaying package configuration, since apt-utils is not installed
#6 3.959 Fetched 1017 kB in 0s (9491 kB/s)
#6 3.980 Selecting previously unselected package openssl.
#6 3.980 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 3.988 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 3.992 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 4.103 Selecting previously unselected package ca-certificates.
#6 4.104 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 4.107 Unpacking ca-certificates (20210119) ...
#6 4.167 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 4.182 Setting up ca-certificates (20210119) ...
#6 4.725 Updating certificates in /etc/ssl/certs...
#6 5.373 129 added, 0 removed; done.
#6 5.415 Processing triggers for ca-certificates (20210119) ...
#6 5.424 Updating certificates in /etc/ssl/certs...
#6 5.992 0 added, 0 removed; done.
#6 5.992 Running hooks in /etc/ca-certificates/update.d...
#6 5.994 done.
#6 DONE 6.2s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.3s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "false" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.3s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:90539ea752b0ab8a3357152395dd1384ed009d3ccd38b0d40d5536ddb640e0f6 done
#12 naming to docker.io/apache/beam_go_sdk:dev done
#12 DONE 0.2s
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0
go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0
/home/jenkins/go/bin/go1.21.0 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 1 -v -timeout 3h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test23091 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test23091 --endpoint=localhost:42331 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.52.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.52.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --bt_instance=projects/apache-beam-testing/instances/beam-test --expansion_addr=test:localhost:45085
# github.com/apache/beam/sdks/v2/go/test/integration
test/integration/integration.go:41:2: "os" imported and not used
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed]
FAIL
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 43187
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpu8j5ccp_/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 46087
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:sparkJobServerCleanup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 41m 47s
275 actionable tasks: 182 executed, 83 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/p4rckmswqwu72
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #3684
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3684/display/redirect>
Changes:
------------------------------------------
[...truncated 693.59 KB...]
#9 349.2 Js2Py==0.74
#9 349.2 mmh3==4.0.1
#9 349.2 mock==5.1.0
#9 349.2 nltk==3.8.1
#9 349.2 nose==1.3.7
#9 349.2 numpy==1.24.4
#9 349.2 oauth2client==4.1.3
#9 349.2 objsize==0.6.1
#9 349.2 orjson==3.9.7
#9 349.2 overrides==6.5.0
#9 349.2 packaging==23.1
#9 349.2 pandas==1.5.3
#9 349.2 parameterized==0.9.0
#9 349.2 pip==23.0.1
#9 349.2 pluggy==1.3.0
#9 349.2 proto-plus==1.22.3
#9 349.2 protobuf==4.24.3
#9 349.2 psycopg2-binary==2.9.7
#9 349.2 pyarrow==11.0.0
#9 349.2 pyasn1==0.5.0
#9 349.2 pyasn1-modules==0.3.0
#9 349.2 pycparser==2.21
#9 349.2 pydot==1.4.2
#9 349.2 PyHamcrest==2.0.4
#9 349.2 pyjsparser==2.7.1
#9 349.2 pymongo==4.5.0
#9 349.2 PyMySQL==1.1.0
#9 349.2 pyparsing==3.1.1
#9 349.2 pytest==7.4.2
#9 349.2 pytest-timeout==2.1.0
#9 349.2 pytest-xdist==3.3.1
#9 349.2 python-dateutil==2.8.2
#9 349.2 python-snappy==0.6.1
#9 349.2 pytz==2023.3.post1
#9 349.2 PyYAML==6.0.1
#9 349.2 regex==2023.8.8
#9 349.2 requests==2.31.0
#9 349.2 requests-mock==1.11.0
#9 349.2 rsa==4.9
#9 349.2 scikit-learn==1.3.1
#9 349.2 scipy==1.10.1
#9 349.2 setuptools==68.2.2
#9 349.2 Shapely==1.8.5.post1
#9 349.2 six==1.16.0
#9 349.2 sortedcontainers==2.4.0
#9 349.2 soupsieve==2.5
#9 349.2 SQLAlchemy==1.4.49
#9 349.2 sqlparse==0.4.4
#9 349.2 tenacity==8.2.3
#9 349.2 testcontainers==3.7.1
#9 349.2 threadpoolctl==3.2.0
#9 349.2 tomli==2.0.1
#9 349.2 tqdm==4.66.1
#9 349.2 typing_extensions==4.8.0
#9 349.2 tzlocal==5.0.1
#9 349.2 uritemplate==4.1.1
#9 349.2 urllib3==1.26.17
#9 349.2 websocket-client==1.6.3
#9 349.2 wheel==0.41.2
#9 349.2 wrapt==1.15.0
#9 349.2 zstandard==0.21.0
#9 DONE 350.3s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.007 Collecting pip-licenses<5
#13 1.058 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB)
#13 1.066 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.066 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.3)
#13 1.149 Collecting prettytable>=2.3.0
#13 1.166 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
#13 1.229 Collecting wcwidth
#13 1.250 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
#13 2.543 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.709 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8
#13 2.709 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.862
#13 2.862 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.862 [notice] To update, run: pip install --upgrade pip
#13 15.87 INFO:root:Successfully pulled licenses for 118 dependencies
#13 15.87 Skip pulling license for bs4
#13 DONE 16.0s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.3s
#16 exporting to image
#16 exporting layers
#16 exporting layers 14.7s done
#16 writing image sha256:be70e01c8e83c538a115123c47f5a61972c67412577acd309e3a5b5327d1e5d2 done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.52.0.dev done
#16 DONE 14.8s
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava
go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.3s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.34MB 0.2s done
#5 DONE 0.2s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.422 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.536 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.580 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 0.670 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 0.953 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB]
#6 0.954 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.225 Fetched 8542 kB in 2s (4508 kB/s)
#6 2.225 Reading package lists...
#6 2.851 Reading package lists...
#6 3.462 Building dependency tree...
#6 3.604 Reading state information...
#6 3.749 The following additional packages will be installed:
#6 3.749 openssl
#6 3.790 The following NEW packages will be installed:
#6 3.791 ca-certificates openssl
#6 3.873 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded.
#6 3.873 Need to get 1017 kB of archives.
#6 3.873 After this operation, 1897 kB of additional disk space will be used.
#6 3.873 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 4.046 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 4.191 debconf: delaying package configuration, since apt-utils is not installed
#6 4.219 Fetched 1017 kB in 0s (4039 kB/s)
#6 4.240 Selecting previously unselected package openssl.
#6 4.240 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 4.248 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 4.251 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 4.362 Selecting previously unselected package ca-certificates.
#6 4.364 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 4.367 Unpacking ca-certificates (20210119) ...
#6 4.426 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 4.440 Setting up ca-certificates (20210119) ...
#6 4.998 Updating certificates in /etc/ssl/certs...
#6 5.673 129 added, 0 removed; done.
#6 5.714 Processing triggers for ca-certificates (20210119) ...
#6 5.723 Updating certificates in /etc/ssl/certs...
#6 6.272 0 added, 0 removed; done.
#6 6.272 Running hooks in /etc/ca-certificates/update.d...
#6 6.274 done.
#6 DONE 6.7s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.3s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "false" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.3s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:3b1bc6c0a572ab418bcb6b33e05ee492dc6e8f77b7a54595746688badd025b18 done
#12 naming to docker.io/apache/beam_go_sdk:dev done
#12 DONE 0.2s
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0
go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0
/home/jenkins/go/bin/go1.21.0 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 1 -v -timeout 3h --runner=spark --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test9278 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test9278 --endpoint=localhost:33819 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.52.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.52.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --bt_instance=projects/apache-beam-testing/instances/beam-test --expansion_addr=test:localhost:37845
# github.com/apache/beam/sdks/v2/go/test/integration
test/integration/integration.go:41:2: "os" imported and not used
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed]
FAIL
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 36067
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp__hdpsxu/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 42409
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql
> Task :runners:spark:3:job-server:sparkJobServerCleanup
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 42m 29s
275 actionable tasks: 182 executed, 83 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/swr3k4eht5cds
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org