You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/08/02 15:06:41 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #3410
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3410/display/redirect>
Changes:
------------------------------------------
[...truncated 1.22 MB...]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar>
INFO root:external.py:929 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar'> '60449' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:60449
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:40 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4afcd809
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@175c2241
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5bf0d49
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b7a5baa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776aec5c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1d296da
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7c7a06ec
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@75d4a5c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@557caf28
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@408d971b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c6cb480
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3c46e67a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@c730b35
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@206a70ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@292b08d6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:41 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:41 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:05:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.8_sdk:2.50.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7ff5a4d8af70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7ff5a4d8b040> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7ff5a4d8b790> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar>
INFO root:external.py:929 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar'> '44689' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.50.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:44689
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:06:11 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4afcd809
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@175c2241
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5bf0d49
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b7a5baa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776aec5c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1d296da
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7c7a06ec
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@75d4a5c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@557caf28
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@408d971b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c6cb480
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3c46e67a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@c730b35
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@206a70ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@292b08d6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:06:13 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:06:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:06:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:06:15 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 02, 2023 3:06:17 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.8_sdk:2.50.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function pack_combiners at 0x7ff5a4d8af70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function lift_combiners at 0x7ff5a4d8b040> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:710 ==================== <function sort_stages at 0x7ff5a4d8b790> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:588 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.8/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 20 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.8/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg
apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
apache_beam/transforms/sql_test.py::SqlTransformTest::test_map
apache_beam/transforms/sql_test.py::SqlTransformTest::test_project
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=== 9 passed, 14 skipped, 6942 deselected, 57 warnings in 298.45s (0:04:58) ====
> Task :runners:spark:3:job-server:sparkJobServerCleanup
Stopping job server pid: 1240505.
> Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1246609.
Stopping expansion service pid: 1246610.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 217
* What went wrong:
Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 41m 10s
274 actionable tasks: 178 executed, 84 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/zdtlhph7wwgfw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark3 #3413
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3413/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark3 #3412
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3412/display/redirect>
Changes:
------------------------------------------
[...truncated 174.10 KB...]
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.2s
#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.5s
#4 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:c47828347cef6d451af1cd3555ec1d80550ae843c79e82d1619fd5c1208771e8
#4 resolve docker.io/library/python:3.8-bullseye@sha256:c47828347cef6d451af1cd3555ec1d80550ae843c79e82d1619fd5c1208771e8 0.0s done
#4 CACHED
#5 [internal] load build context
#5 transferring context: 2.42MB 0.0s done
#5 DONE 0.2s
#6 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#6 CACHED
#7 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#7 CACHED
#8 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#8 ERROR: "/target/launcher/linux_amd64/boot" not found: not found
------
> [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found
> Task :sdks:python:container:py38:docker FAILED
> Task :runners:spark:3:job-server:sparkJobServerCleanup
> Task :sdks:go:container:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile:
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.2s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.2s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.5s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:630454da4c59041a2bca987a0d54c68962f1d6ea37a3641bd61db42b753234f2
#4 CACHED
#5 [internal] load build context
#5 transferring context: 24.05MB 0.3s done
#5 DONE 0.3s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 3.801 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 3.891 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 3.928 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 5.037 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB]
#6 5.359 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [252 kB]
#6 5.458 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.3 kB]
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar FROM-CACHE
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.58kB done
#1 DONE 0.3s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.2s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:7d0337d8e1d13d5af166eb17d4d37eaa30767cc8d3010d4501eaaca48e917ce1
#4 DONE 0.0s
#5 [internal] load build context
#5 ...
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:7d0337d8e1d13d5af166eb17d4d37eaa30767cc8d3010d4501eaaca48e917ce1
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.02MB 0.5s done
#5 DONE 0.6s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 7.7s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.2s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.2s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.2s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
> Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts
> Task :sdks:go:container:docker
#6 7.133 Fetched 8661 kB in 4s (2300 kB/s)
#6 7.133 Reading package lists...
#6 8.264 Reading package lists...
#6 8.938 Building dependency tree...
#6 9.109 Reading state information...
#6 9.393 The following additional packages will be installed:
#6 9.393 openssl
#6 9.418 The following NEW packages will be installed:
#6 9.420 ca-certificates openssl
#6 9.492 0 upgraded, 2 newly installed, 0 to remove and 2 not upgraded.
#6 9.492 Need to get 1012 kB of archives.
#6 9.492 After this operation, 1892 kB of additional disk space will be used.
#6 9.492 Get:1 http://deb.debian.org/debian-security bullseye-security/main amd64 openssl amd64 1.1.1n-0+deb11u5 [854 kB]
#6 9.632 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar
> Task :sdks:java:container:java8:docker
#10 DONE 0.3s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.8s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.9s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.4s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.2s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.2s
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.7s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.2s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.4s done
#21 writing image sha256:8a2a095c29a5f7f6465e8e356aee8559d47ad4f055fdd6551a1abcbb614a6813 0.0s done
#21 naming to docker.io/apache/beam_java8_sdk:2.50.0.dev done
#21 DONE 0.5s
> Task :sdks:go:container:docker
#6 12.16 debconf: delaying package configuration, since apt-utils is not installed
#6 12.26 Fetched 1012 kB in 0s (4678 kB/s)
#6 12.40 Selecting previously unselected package openssl.
#6 12.40 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 12.64 Preparing to unpack .../openssl_1.1.1n-0+deb11u5_amd64.deb ...
#6 12.65 Unpacking openssl (1.1.1n-0+deb11u5) ...
#6 12.79 Selecting previously unselected package ca-certificates.
#6 12.80 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 12.80 Unpacking ca-certificates (20210119) ...
#6 12.87 Setting up openssl (1.1.1n-0+deb11u5) ...
#6 12.89 Setting up ca-certificates (20210119) ...
#6 13.65 Updating certificates in /etc/ssl/certs...
#6 14.47 129 added, 0 removed; done.
#6 14.55 Processing triggers for ca-certificates (20210119) ...
#6 14.55 Updating certificates in /etc/ssl/certs...
#6 15.10 0 added, 0 removed; done.
#6 15.10 Running hooks in /etc/ca-certificates/update.d...
#6 15.10 done.
#6 DONE 17.1s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip
> Task :sdks:java:io:google-cloud-platform:expansion-service:assemble
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check
> Task :sdks:java:io:google-cloud-platform:expansion-service:build
> Task :sdks:go:container:docker
#7 DONE 0.6s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.2s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.4s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:042e5a1995d4a645c8ed8d9775dafdb65ae88c72e8007ed13f58c746ded0951c 0.0s done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2m 24s
267 actionable tasks: 175 executed, 80 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/yo4nurpnazklk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_Spark3 - Build # 3411 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_Spark3 - Build # 3411 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/3411/ to view the results.